Your feet will sweet in them, they will smell, they will slide around.
Your feet would dumb as shit with socks on them and Toms on.
Your feet look dumb as shit with or without socks if you have Toms on (not a personal dig because obviously I don't know you). Buy a pair of shitty, low quality, ugly as fuck slippers so a poor kid can have them? Fuck that.
Tom's is actually fucking up these countries more by giving them stuff: in short, people in the countries are basically not doing shit to try and take care of themselves because they're given the idea that rich people are going to send them food and shit.http://blogs.pointloma.edu/thepointweekly/2009/09/28/toms-shoes-not-the-right-fit/
HOWEVER, I think the silhouette of the shoe (espadrilles) is feminine, but it can be done right for men. APC's version is amazing, but they're like $200. I don't think "normal" people can make them look good, you pretty much have to be a sartorial badass to make them work.