Shuffle on Playlists isn't Shuffling

[BgrizzR]

I have a playlist with a lot of songs, and I know I can't play them all if I hit shuffle. That's not the issue. Now that that's said, the issue started with the new update that overhauled the mobile UI and such. Now whenever I hit shuffle on my playlist, it plays the songs in order. I don't have premium or anything, so this shouldn't even be possible. It's extremely annoying to have to listen to the same songs over and over, so I would like to know why this is happening, and how I can fix it. Thanks!