Honestly I've never tried it before because I don't often look at the "new replies to your posts" for this exact reason. xD
Have you tried going to the thread, clicking notify, enabling it, and then disabling it? Not sure if it'll change anything, but it's worth a shot I guess? o: