That's because they all keep coming and going. Even I have a hard time keeping track.

I'll bet the only person who even knows how many of us are really here is the girl who run the Welcome Center.

[It was set up long after Midii's arrival, but her assumption was that most, if not all, people stopped there at some point after arriving for the first time. Maybe even the second.]