"Fred is the only man alive who still remembers my father as an infant. When Fred first saw my father, he was twelve years old." is a true sentence.

Does this mean that "When Fred first saw my father, Fred was twelve years old."?
yes