Hey juni ,
First of all, welcome to the Buttonizer Community! 🥳
Buttons are cached on our server for a proximally one minute when visiting a site, so if you delete or hide a button, it will still appear until the cache has expired on our server. So in extreme situations, it can take a few minutes after publishing your changes before the changes appear.
I've checked your site now and didn't see any buttons appear at this moment. Is there a specific page where the button is still appearing? Then I'll take a look for you 🙂