Can't I just say "Voy a pasar tiempo con mis amigos"?

You can also talk about the future using IR + A + Verb and say it this way. The two ways of expressing future are essentially the same. However, using the future tense often sounds stronger, or gives a stronger sense of obligation or intention that something will happen.