By the words you have chosen to use, you have indeed come to the conclusion that these two minority groups, Blacks and Hispanics, have "negatively brought American society down." The only thing you are unsure about is which group has "brought it down" the most.
You seem to have missed the rest of my response. I do not know whether you did not read it or you are unwilling to respond to it, either way, I have reposted it below on the off chance that you are willing to answer it. Please tell me if you are unwilling to respond so I can give up on this conversation.
My previous response which you may have missed:
"The question you are asking is not simple and cannot be answered in a simple way. You are being disingenuous if you say it is...You cannot intelligently answer it without knowing how you define "hindering" or without taking into account the history and social statuses of Black and Hispanic Americans. Believe it or not, things that happened in the past affect things that happen in the present...define what you mean, or rephrase your question in a more approachable manner..."
Please tell me how you define the terms in your question, specifically, what exactly you mean by "hinder" and "progress", OR rephrase your question to make it more approachable, for example, maybe what you actually want to ask is, "Which minority group, Blacks or Hispanics, have higher rates of poverty and are more disenfranchised?"
The question states: Who is holding America back? Hindrance is defined as a thing that provides resistance, delay, or obstruction to something or someone. Progress is defined as a movement toward a goal or to a further or higher stage. The prime reason to leave my question ambiguous in nature is to conjure intellectual debate if one finds fault in it.