A Swordfish once dived on an enemy submarine in the Mediterranean while carrying an anti-ship bomb rather than the smaller anti-submarine weapon mentioned in the question. The reported result suggests that the bomb passed through the submarine and detonated either inside it or beneath it. The exact detonation point is uncertain, but the submarine was destroyed. The episode shows why the Swordfish's operational flexibility matters more than a single role label.
Notable Point · 1:50:40-1:51:29
A Swordfish dive-bombing attack on a submarine
A Mediterranean Swordfish attack illustrates how an aircraft nominally classed as a torpedo bomber could use an anti-ship bomb against a diving submarine.