Hello,
I completely agree with you!
I wrote a dedicated topic where I shared my feedback, thoughts and suggestions for improving it.
Feel free to read and comment on it here: Single-Button Assistant - Great Feature! - Community / General Discussion - World of Warcraft Forums