The town was first settled in 1829 when Hiram Capron bought the land and built a mill on the present townsite.
Many of the early buildings were made with abudant amounts of locally made plaster of Paris, which lead to the town's current name.