Upscale chains are taking heavy hits