The 200-year-old state features America's oldest covered bridge and had the first flush toilet west of the Hudson River.