Hello Tia
No you do not need any plugin for it.
Go to google maps > search any location > click on share > click on embed a map > click on copy html code
Go to wordpress dashboard > appearance > customize > contact us page > paste the code in the map embed code text area > click on publish > refresh your contact page
That is it it will appear.
Thank you