Hi Julia,
With only 4 hours you wont have time to go far. As long as you stay well clear of the traffic (ferry) lanes you should do OK.
I have fished the eastern side around Collins Beach in the past with good results. The bay east of Smedleys would be my suggestion.
itsaboat mate...Life is just a boat and then ya marry one !