Although studies have shown that sexual orientation can be judged from faces, this research has not considered how age-related differences in perceivers or targets affect such judgments. In the current work, we evaluated whether accuracy differed among young adults (YA) and older adults (OA) for young and old men’s faces by recruiting a sample of YA and OA in the lab, a community sample of sexual minority men, and a sample of online participants. We found that OA and YA judged sexual orientation with similar accuracy. Perceptions of gender atypicality mediated the difference in judging older and younger targets’ sexual orientation. Although participants used positive affect to correctly discern sexual orientation regardless of target age, perceptions of masculinity were valid only for judgments of YA.