Japanese used night raids, by types such as the betty to harass USN carriers at night. They had some success with these techniques, as they were fully intent on hitting the carriers if at all possible. They are in the category of nuisance raids, because the numbers of attackers involved in these nuisance raids were always small
In the jungle, the IJA did not use aircraft, but they would use individual soldiers to play on the fears of the GIs who made generally poor jungle fighters, usually spooked by the terrors of the night and the unknown green hell as they referred to it.
The Japanese were very aggressive jungle fighters, and played on this US timidity. They had a harder time against the Australian army, which had proper training programs underway for jungle fighting at places like the Jungle warfare school at Canungra (from november 1942), the gureilla warfare school at Forster in Victoria, the special forces warfare school on Frasier island, much of the training work pioneered and worked out from the beginning of the war in the pacific at the mobile Forces HQ based in Darwin. The Japanese had established similar training schools before the war on the islands of Formosa and Palau, and later on Sumatra and the PI. the US lagged behind these pioneering efforts which made life difficult for their general entry recruits in the jungle. These difficulties did lead to a change in strategy by the Americans, After their brutal experiences on guadacanal, the central solomons and New Guinea, they all but abandoned aggressive patrolling. They would capture the facilities they needed, let the remainder "wither on the vine", whatever the hell that was supposed to be, and then move on. as a strategy it worked, kind of, but it was driven, in part by the poor showing and lack of confidence in the jungle, that in part was brought on by the effects of these nuisance attacks on their untrained troops.