Why were the Hubermann’s so concerned when they couldn’t find their flag?

Since it was Hitler's birthday, everyone had to hang their Nazi flags outside their house and the Hubermann's had not done that yet because they couldn't find their flag. Not hanging it would draw suspicion from the Nazis.