I agree TeamViewer would not be the way to go. Plus why do you need visual control of the system? If you want you could always program your router to allow access to the front end of QuickBox on your server? Then again I always view everyone running their QB box from their house like me with a quadcore as a router firewall to really sort traffic and block stuff.
Otherwise I agree that just go with a secured SSH tunnel, or something like x2go. Something that is not going through a hosted service somewhere else, where someone COULD spy on you or be hacked and "evil hackers" gain access to your login/IP credentials.
Never trust your data to anyone that you don't have to!