We're the humans worried about the prospect of alien invasion

Of course they were not, it states clearly at the very start of the book.

"No one would have believed in the last years of the Nineteenth century, that human affairs were being watched from the timeless worlds of space..."