Two things.AIUI, almost all TBF CVE operations involved the use of catapults. Swordfish were primarily used on CVEs that didn't have catapults.
Firstly, with the exception of the Pretoria Castle largely used as a trials and training carrier, British built escort carriers and MAC ships weren't equipped with catapults.
Secondly, Swordfish were used by squadrons on RN US built escort carriers. Check out the histories of ships like Biter, Fencer, Striker amongst others between 1942 and 1944. But the Swordfish was incompatible with US catapults and their tail down launch methods, so couldn't use the catapults on these ships.
For that reason Swordfish were later equipped with RATOG (Rocket Assisted Take Off Gear) to aid their take off at high all up weights. This was especially so for the Mk.III with its large centimetric radome between its undercarriage legs which entered service from mid1944.