Oak Bluffs selectmen agreed this week to sign an intermunicipal agreement that will allow the county to buy a building to house the Center for Living, but they balked at a second agreement that would establish oversight of the nonprofit organization’s programs for elderly Islanders.