Always see boats anchored around the yellow patch area at night. Imo if the weather/forecast is good there is not much point burning extra fuel and going back around the cape, we will usually anchor up where ever we are fishing be it Roberts Shoal or Deep Tempest.
PS. my boat is only 5.1m if that helps.