Plex LXC (unprivileged) using 100% SWAP?

The container I run plex on has plenty of spare memory but is still using 100% SWAP. First off, is this an issue I should be concerned with or try to fix? If so, any ideas?