Browntown once had a single Chicago, Milwaukee, St. Paul & Pacific Railroad (Milwaukee Road) branch line, now part of the Cheese Country Trail.