As ordinary consumers trade down and the wealthy keep spending, mid-market firms look vulnerable