you're with no one.
When you are with no one but me,
you're with everyone.
Instead of being so bound up with everyone,
When you become that many, you're nothing.
I interpret these verses as a words to the lover. Reemphasizing the importance of the poet's presence but, the last lines seem so profound.