It will be up to voters whether the town should buy a 28,000-square-foot building to house the town offices and other services.