Ease of travel to all sections of the county makes Spencer a desirable area in which to live. Route 31 gives access to Holden, Fitchburg, Leominster in the north; Charlton, Oxford and Southbridge in the south. Route 49 gives easy access to Sturbridge, Brimfield, Southbridge, the Mass Turnpike and Interstate 86 to Connecticut. Route 9 leads westerly through the Brookfields and Ware to the Amherst Campus of the University of Massachusetts and easterly to Worcester, Shrewsbury, Northborough, and Westborough. In addition to its own small commercial airfield on Paxton Road, Spencer is less than twenty minutes from Worcester airport and the industrial complex located next to it.

Spencer is also home for several large dairy farms, indicating that the town's fertile soil is not only suited for residential use. Several major lakes and ponds are also located in the town, including Stiles Reservoir, Thompson Pond, Lake Whittemore, Cranberry Meadow, Sugden Reservoir and Brooks Pond, providing recreational boating, swimming and fishing for the public. Settled in 1717 by Nathaniel Wood, Spencer was incorporated as a town in 1753.

Spencer Mass is located in Central Massachusetts, bordered by Oakham on the north, Paxton on the northeast, Leicester on the east, Charlton on the south, and East Brookfield and North Brookfield on the west. Spencer is 11 miles west of Worcester and 51 miles west of Boston.