I think I've seen most of the older boys holding Andy. In this episode, it was the book smart one (I forget his name).
With such a large family, I guess we can assume (and actually see) there's always someone around the house. That's what I like about this show.
Other shows like Single Parents drive me nuts because I haven't seen or heard where the baby is for episodes at a time.