Can I keep baby society finches in a large cage that includes zebra finches?

I have a large cage with 3 pairs of zebra finches and 1 pair of society... well I just found babies hatching in the society's nest. Is it ok to leave them there? Will the zebra's hurt them? or should I move them to another cage? Thanks :)