This house was built and first owned by John Sherman, cousin of General William Tecumseh Sherman. The "widow's walk" and circular window are key elements of the first structure moved to Heritage Park in the spring of 1971. From 1892 to 1965, sisters Bess and Gertrude Gilbert, patrons of art and music, brought internationally famous entertainers to receptions in their home. Among the artists were Yehudi Menuhin, Ernestine Schumann-Heink, and Artur Rubinstein. The park office is located on the bottom floor.

The Shermin-Gilbert house exterior has yielded some minor activity. A shadow figure has been allegedly seen moving towards the backside of the building, but to date has not been captured on media. Some sessions using dowsing rods have been performed outside the location in an attempt to communicate with this possible apparition.