North Harmony is one of the youngest towns in Chautauqua County, having been incorporated in 1919. Prior to that year, the land and communities within the town had belonged to Harmony. North Harmony covers over 40 square miles, with its eastern border being Chautauqua Lake and the town of Busti and its southern border being the town Harmony. To the north is the town of Chautauqua and to the west is Sherman.