Has it been happening recently, or since you first started playing?
You shouldn't have to restart your whole computer if the only problem is FH not closing.
Try pressing Ctrl+Alt+Delete and open the Task Manager, and Click on Feral Heart, then End Task.
If that doesn't work, try going into the Processes tab, and find FeralHeart.exe on there. That should close it.