Shuffle on specific playlist

[WessTheMess]

I'm using an Android phone, and I've been using Spotify for years. I've never had this problem. I made a new playlist with songs that aren't in any other playlists. But whenever I play the playlist and I enable "Shuffle" it will just start playing all songs from the same artist in the playlist in a row. Normally when you would click the shuffle button twice, it will reshuffle the upcoming songs again. It doesn't do that on this playlist at all. I've also tried restarting the app, but this doesn't seem to fix anything either. Is there anyone experiencing the same issues or anyone that knows how to fix this? Thanks in regard!