If I wear a 32 in Levis 511's, should a size down be okay for Mercer Pants?