According to Alfred Nevin, Churches of the Valley (1852), the Marsh Creek Presbyterian Church was organized in 1732, and divided into Upper and Lower Marsh Creek congregations sometime after 1740. The Upper Marsh Creek Church (“Old Side”) shared a minister with the Great Conowago Church for many years, while the Lower Marsh Creek (“New Side”) shared ministers with Piney Creek or Thom’s Creek Presbyterian Churches.

According to a 1963 published history of the congregation, the Upper Marsh Creek Church moved into Gettysburg in 1813. In 1868, it officially changed its name to the Presbyterian Church of Gettysburg.

After the cemetery dedication, President Lincoln returned to the Wills House for a late lunch, followed by a public reception. There he met John L. Burns, the famous and fiesty 69-year-old Gettysburg cobbler who once served in the War of 1812. On July 1, 1863, Burns spontaneously picked up a rifle and joined Union troops, receiving multiple wounds.

Lincoln walked down Baltimore Street with Burns to the last event of the day at the Gettysburg Presbyterian Church. Here they heard a speech by Charles Anderson, Lieutenant Governor of Ohio and the brother of Robert Anderson of Fort Sumter fame. The church Lincoln visited has been replaced by a newer building on the same site.