How to add a tool window to an exisiting VS extension package?

I have a VS package with no tool windows, and now I want to add a first tool window to it. There are a few articles on MSDN on this subject, but they all boil down to creating a package with tool window option checked. But how can I add a window to a package that already exists?