Not at all. You can click on your account switcher in the bottom center. Then the popup will show a + at the top right, and it will let you create a new account on any server you wish and use it with voyager.

For example, I’m on the lemmy.blahaj.zone instance, and I am communicating to you with voyager.