When Merry stabs the Witch King with a knife, he was actually using a weapon that was forged specifically to fight him. He found the knife in a region near The Shire known as ‘The Barrows’ in which the tombs of warriors who had fought against The Witch King were filled with weapons that could hurt him.