OK, finally. Jack versus Tojo, or J2M versus Ki-44. First, I'm using the TAIC Report # 2 dated 1945 for the comparison. Never mind when they first flew, I'm talking about the J2M3 versus the Ki-44 II. They first started flying the Ki-44 family operationally in some numbers in Jan 42 and the J2M family was first seen in some numbers in Dec 42. So, the Ki-44 had about 10 months on the J2M operationally. They built some 1,225 Ki-44s and some 621 J2Ms, so there were about twice as many Ki-44s as J2Ms.
Weights: Ki-44 was 4300 lbs empty, 6100 lbs normal load, 6610 lbs overload. The J2M was 6259 lbs empty, 7079 lbs normal load and 8130 overload. So, the J2M was slightly heavier empty than a Ki-44 at normal fighter take off.
Power Loading: Look at takeoff, best mil power, and best WER power. Ki-44 II: PL takeoff: 4.07 lbs/ hp. Best mil power: 4.69 lbs/ hp at 17,200 feet. Best WER: 3.89 lbs/hp at 5,000 feet. J2M3: takeoff: 3.91 lbs/ hp. Best mil power: 4.69 lbs/ hp at 18,100 feet. Best WER: 4.10 lbs/hp at 16,600 feet. So, there is very little to choose as far as power loading goes and, at best military power, they are even up. J2M has about 2,500 feet better service ceiling (38,800 feet versus 36,350 feet). But, after finding out they couldn't hit anything at 30+ thousand feet, the B-29s were coming in at around 20,000 feet anyway, so the advantage is not really all that useful.
Wing loading at normal weight: Ki-44 II: 36.09 lbs/ square foot. J2M3: 33.89 lbs/ square foot. Very little to choose between them, but the J2M comes in maybe 6% better. Doesn't translate into much in the real world.
Speed: J2M3 is 32 mph faster at best height and 24 mph faster at sea level. At sea level, both are around as fast as the US opposition. Around 20,000 feet, the Ki-44 is maybe about even with US opposition or slightly slower, but the J2M3 is 30+ mph faster. That 32 mph would make a BIG difference if chasing a B-29, but little difference practically if engaging with fighters because the faster fighter opposition is faster than both Japanese aircraft and the slower opposition is about even with the Ki-44 II, making it not so much of a factor unless chasing B-29s.
Climb: Both are 1,000+ feet per minute better than any US counterpart.
Armament: US opposition has 4/50-cal or 6/50-cal. Technically the Ki-44 II has 6/50-cal and 2/40mm cannons … but the cannons have only 10 shots and the shells are slow, so they are not much use. The J2M3 has 4/20 mm cannons for an obvious armament advantage, especially against bombers.
From the above, I say the Ki-44 was an EXCELLENT choice, especially for 10 months when there were no J2Ms around. There were twice as many available and the Ki-44 likely was more reliable, given reports of J2M malfunctions. Range without extra fuel tanks was about a wash, with the Ki-44 II having slightly more combat range at 1,500 feet (740 miles versus 670 miles). Admittedly there wasn't a lot of fighting at 1,500 feet, but it is the comparison we have.
I'd say twice as many Ki-44 IIs would tip the balance in favor of the Ki-44, but nobody would be unhappy with a J2M3 as long as it was running correctly. From what I hear, that was a gamble for many J2M pilots. I'd take the old reliable Ki-44 II if offered the choice, based on the numbers. But, the Ki-44 was more lightly built, and that MIGHT affect the choice. Still, a reliable airplane is likely a better choice than an unreliable airplane.