Have you reset the character's home that you've been in the Grounds with? If you reset the character's home, it will take them back to Lonely Cave and then you can try re-entering the Grounds. I recommend trying to enter the Grounds from the portal within Seaside Grove. Sometimes, for some reason, crashing occurs in a repeated fashion and so entering from a different portal solves it sometimes for me.