The performance boost isn't that great unless it's a map completely filled with objects.
Also keep in mind, if an object is placed within the map and has the "Object Is Big" marked to it, they will not be affected if you lower the view distance. Only small objects will disappear as you lower the view distance.