Are you sure it wasn't the next bend to the south? That would have been the location of Conway station, and perhaps it was a pedestrian underpass. There was actually a streetcar line that ran down the hillside, crossed the river (a pillar is still there in the river), crossed under the high trestle of the NYNH&H, and ran to Conway.