Man, Harry and Louis must have been such an annoying baby couple to the other boys during the x fact