I know how to take criticism, but when someone critics your brand it shouldn't be about the logo being on t - shirt. My choice of words might have been a little harsh but come on, " your logo on a t shirt isn't right"? Seriously that is ridiculous. If your making a comment lets see your work.
What the person was trying to say is that the design work is lacking. You really did just put your logo on a couple shirts and hoodies. Haha there is nothing really wrong with it, and if you liked it and thats how you want to design it, by all means go for it. But what they were trying to say is that it's fairly generic and basic, and nothing really knew to the table.
most start up brands like to incorporate a few designs into their first line to hit the ground running. but everyone does it differently. good luck