'In the Wilderness' in the Bible

harden not your hearts, as in that bitter provocation, at the day of the temptation in the wilderness;

But against whom was he incensed forty years? Was it not against those who had sinned, whose corpses fell in the wilderness?