I was there last week and got a few on the Iluka walls near the harbour entrance. I don't take my boat when I go to Iluka so I can't say how the middle wall was fishing but there were very few boats fishing it when I was there - mostly one or two on the whole middle wall at any time.
Cheers Freeeedom