Im running a 16 slots tf2 server on a linux vps (ubuntu 16.04) and the server always has some small "freezes" that last about a sec and this is really annoying me, any ideas on what it could be?

server specs:
1vcpu (2.20ghz)
2gb ram
OpenVZ
1gpbs shared connection (got about 300mpbs on a speedtest)

cpu usage is about 60% when the server is full, about 600mb/2gb of ram being used swap is usually on 0/256mb.

connection settings:

sv_maxcmdrate 66
sv_maxrate 0
sv_maxupdaterate 66
sv_mincmdrate 66
sv_minrate 20000
sv_minupdaterate 66

I'd say those spikes happen 6-7 times on a 30 minute match. I tried changing the niceness to values like -10 and -20 but it didnt help much.