What indication is there that the cave might not be safe?

The reader knows that the caves aren't going to be safe from context clues; first, Gandalf cites that caves are seldom unoccupied........ second, the dwarves sent ahead to check things out weren't very observant and scouted the area far too quickly (Fili and Kili).