Hi @hoerschatz ,
Thanks for reaching out to us!
You should be able to delete an existing button by clicking on the three dots menu next to its name.
From there, you will be able to find the delete button.
After deleting the button, make sure to publish your changes.
Let me know if you were able to delete your button! 😄