My (now) wife and I started a joint account after we moved in together (shortly after getting engaged) and have had it that way since.  At the time we were two incomes, now it is just one and she is holding down the homefront.  She manages our finances, we go through it regularly and it works VERY well for us. 

More than anything it depends on your partner and whether or not it works.  Your seems to be working just fine, I wouldn't worry too much about what other people say.