Don't know if it weakens the mechanism (I've done it habitually for years), but the trays are tougher than they look. Apparently some survey revealed that many novice users regarded them as trays for plastic cups!
After occasional use as such, they were none the worse.