how to control Spotify on my phone with Spotify on my watch?

[overground55]

I'm using Spotify Premium, I live in the US, I have a Samsung Note 9, and I'm using a Galaxy W Active 2

When listening to music on my phone, it would be nice if I could change songs by hitting song back or song forward on my watch. When I try this, what ends up happening is that it tries to start playing on my watch, which I don't want. Is there a way to have it simply change the song, while continuing to play through my phone?