I have three different Spotify Connect devices - if I turn off wifi on my phone, I can still connect to two of them; the only one I cannot connect to is also a Google Cast device, so maybe that one utilizes some (local network only) Google Cast protocol rather than Spotify’s own? (All three devices are from the same manufacturer.)