How is your population data (age data) stored? As points or polygons?
If points, you can use Spatial Join with the polygon as target and points as join features. In the field map, add a new field of type long - set the Merge rule to Median and input field to be the age field of point data.
The output of Spatial Join will have a new field with median age.
