There are two issues with your plan.
1. The weight and volume of early radio control equipment and therefore the size of the machinery required to contain / carry the torpedo itself (I'm not referring to the launch aircraft, although it would have an effect on that also)
2. The weapon is then not, in modern day terms, "fire & forget". A launch aircraft needs to hang around to direct it. And that exposes it to long range AA fire & enemy fighters.
Siemens in Germany developed a wire guided glide torpedo in WW1 for dropping from Zeppelins but it was never used.
The USN developed a glide torpedo as far back as 1917/18.
The USAAF restarted development of a glide torpedo in WW2 eventually deploying one squadron in the 41st Bomb Group to Okinawa with the GT-1 in mid-1945 where they were used operationally on a number of occasions before the war ended.
The GT-1 (Glide Torpedo 1) was an early form of missile developed by the United States Army Air Forces during World War II. Intended to deliver an aerial torpedo at a safe range from the launching aircraft, the weapon proved successful enough in t...
axis-and-allies-paintworks.com
While various success claims were made for them, most (all?) were not verified, which proved the biggest problem in their use. For example the carrier claim was not correct as no carriers were present at Kagoshima in July/Aug 1945.
When the Germans deployed the Hs293 glide bomb in 1943, one effect was to trigger the restarting of development of faster firing, high elevation, longer ranged, 6" AA guns and turrets by both the RN and the USN. That weapon, and the freefall guided Fritz X bomb fell victim to firstly jamming (within a few months) then better fighter cover to down the carrier aircraft. And of course the Hs294 never reached operational service.