We recently took our 3-week old son to my wife's oath ceremony, and noted many other children & spectators present. So yes, children and relatives are allowed to attend. This is definitely true for Baltimore DO, and I have no reason to suppose it would be different anywhere else.