Well, they need at least three feet to right themselves if they fall, so ideally they want to be higher than that. Plus cats can survive falls from several stories. So I doubt jumping down from a high tree poses much of a problem for them, health-wise.
The stupidness emerges when they climb up something and then can't work out how to get back down without jumping so just sit there crying.