The lava is water just with a different texture. Its like red dyed water, it looks like blood but its not. Just plain old water with red dye in it.
Just jump in the water and swim in it, different texture or not. Thats why waters there, to enjoy it, to swim in it, to live with it. Just because the texture looks like lava doesnt make it lava its still water, you are still able to swim in it.