Well, that is a thought. If you are going to rescue downed airmen, you have to assume that the enemy guys in boats will take umbrage at that. And you have to assume that any enemy lifeboats or motor launches will not treat kindly an airman who has just sunk their ship.
When rockets were first introduced on Swordfish to attack U-boats they sunk one, and recognizing that they needed to keep the weapon secret for as long as possible, the Wildcat escort began to strafe the U-boat survivors. With the rockets they wanted U-boats to try to fight it out on the surface and not recognize that the aircraft had a weapon that hit them with devastating force from a distance. The Swordfish called, "Wait! A destroyer is on the way and we need some of those men to interrogate." The Wildcat pilot replied, "How many of them do you want me to leave?"