G'day
You'll be fine, just be wary of the bigger wakes from cruisers down there and be prepared to bail to remove the water from within.
Have a friend with a second boat if possible to help out carting the stuff over.
IMO to minimise risks, leave no later than first light on a week day, not too many cruisers down there doing the rounds at that time.
Dave