I recommend paying more attention. If someone were looking for an excuse to pretend these people don't have real reason for specific concerns, they might produce a comment rather like the above; perhaps you weren't consciously doing that, but inattention can produce the same effect.