Do you have to stay signed in to get incoming calls?

No. After logout, you can still receive offline messages.