When they couldn't find their flag, what did Rosa mean by they'll take us away?'

The flag is, of course, symbolic of their support of the Nazi government. Any sign that a family is not on the side of the Nazi rulers could result in that family being taken from the city to a concentration camp.