Damn. That's the only other possibility I could think of.

[Beyond 'painful lonely death in a mountain cave', but let's not think about that one.]

If he was taken back home, it was definitely against his will. He wouldn't have left you here alone willingly, even if two of his Pokémon still remain.