Colfax is a city in Richland County, North Dakota, United States. The population was 121 at the 2010 census. Colfax was founded in 1881. It is part of the Wahpeton, ND–MN Micropolitan Statistical Area. In the mid-1960s it billed itself as the "smallest town in the U.S. with a public swimming pool".