The drivetrain was layed out for a 35 tonne vehice, the Panther became a 'tad' heavier. They couldn't produce sufficient complex final drives capable to cope with the increased weight (as used in the Tiger series) so they had to stick with mass-producable less reliable final drives. They improved over time but stayed weak.
If they had opted for a rear drive in 40/41 they could have fixed this during development.