Server/game lag

Hello folks of r/Valheim!

My friends and I have been experimenting with hosting our own Valheim server and a hosted one. We've encountered a very interesting issue.

Our village is pretty built up with 4 sizeable houses, a small(ish) portal hub, blacksmith, apothecary/map room, farmhouse/cook house, and a Mead Hall that's been stuck in construction complications for the last 2 months.

The issues we're having have manifested on both the privately hosted server (hosted by me) and the paid host server.

Here are the issues (they only happen in our village):

*Can't open any chests/doors after portaling into town. Takes at least 20 seconds for the server to catch up.

*Enemies float, warp, spawn in the ground, ignore workbenches and spawn in our village. During raids, they spawn in, running in place with a "HELP ME YOU MISERABLE IDIOT!" kind of energy. Again, can take the server up to 20 seconds to catch up.

*My wife is our resident farmer (vegetables and animals) and has complained of holy turnips, onions and carrots. They'll float Up into the air before going into her inventory.

*Our framerates TANK while in our village. For the couple of us that have older machines, this means we go from a stable 60fps to 10fps. One of our friends has a 3080ti and he dropped from 150+fps in the world to 40fps in town. He is running on 2 1400p (165hz) monitors. His cpu is an AMD Ryzen 9 5950X. Again, only happens in town.

*The waves from the ocean can take 20 seconds or more to catch up. We've watched our ships go up in the air (sometimes by 5m or more), slam down, fling us off, slam into our dock, or any other ships nearby.

*Chests/Doors can take 20-30 seconds to be opened after portaling in or running in through our gates. We've taken to hopping our walls if needs be.

In talking with our paid host, we've come to the conclusion that it's just Valheim being weird. They've checked, double and triple checked their hardware, moved us to different regions in their server farms (went from Washington DC to Industry City, CA, and now to Dallas, Texas). Our pings are stable at 25-50ms.

So, sorry for the long novel here. The TL/DR of it is, have any of you hosting servers run into issues like this? The issues are there whether or not it's a hosted game or single player.

Granted, hearing my wife grumble-squeak about chasing down holy turnips is rather hilarious.

Thanks for any insight you guys can give!

AngryITSasquatch