Toolbar Button Doesn't Work Unless File is Selected

I have added a new toolbar to the top of the screen. There are several buttons the handlers for the buttons are only live when I explicitly select a file in the solution explorer. You are able to click them but the handlers don't get called. When I explicitly click on a file in the solution explorer they seem to work again. Any ideas?