Where's the honey?

We've now had a super in place above two hive bodies for over 4 weeks. Last night when we checked the super we saw NO evidence of drawing out comb. None. Zip. We did see a few bees in the super hanging out but that is it. We are using a queen excluder and it seems to be keeping out more than the queen. I suppose we could take it out, but we really don't want brood in with our honey when it comes time to harvest. Could we have damaged or killed the queen when we took out the comb they were building in the empty frame slot?

We're gonna let them go a bit longer and see what happens. It's been hot so we tilted the lid up last night too and perhaps that will give some of them another entry point. I'd really like to get at least a little honey this year out of our hive. But, at least we have two good bodies now full of drawn out comb with brood and honey stores. If we can get them to over winter well they should have a much better start than they did this year with a new hive.