If it is an actual legitimate interest then you would likely be expected to contact the site out of band to object to the use of your data. Depending on the technical details you might not be able to continue using the site after a successful objection. In some cases the site might be able to reject your request.

The cookie banner thing is intended to allow the user to explicitly provide consent, should they for some reason wish to do so.