The Met Museum even has a digitized “athletic shorts” collection.  Brilliant!  …and very useful for designing characters’ outfits.

They could specify what gender the clothes are though.  Sometimes it can be hard to tell.  Source: http://www.metmuseum.org/collections/search-the-collections/79018?img=0