Fears of renewed inflation are weighing on people's economic mood. That could affect their spending and the broader economic outlook.