Town and gown is a term used to describe the two communities of a university town; "town" being the non-academic population and "gown" the university community.

http://en.wikipedia.org/wiki/Town_and_gown