If you go into Ficho Tunnel, near the portal to Bonfire Island, there is a small waterfall, and behind that waterfall is a portal to the Lonely Cave (you will see nobody in the Lonely Cave even if there are people there, hence the name). In the Lonely Cave there is a portal to the South Pole (along with a few other portals around the place). Just go through it, and you're there.