The rural estate subdivision known as Historic Elmwood, near the Village of Carp, takes its name from Gourlay House or “Elmwood”, constructed in either 1861 or 1891 (sources differ) by Hugh Gourlay, the son of John Gourlay, an Irish immigrant. It was a large Nepean sandstone structure, built to an unusual clover leaf-shaped plan. It continued to be occupied by descendants of the Gourlay family until 1961 when the last member of the Gourlay family moved out. The Gourlays played an active role in the early history of the area as they were among the first immigrants to arrive there and were well known in the community as farmers and community leaders.

After it was abandoned, the house was vandalized and fell into ruin, finally burning in the early 1980s. The walls were exposed to the weather and plans to rebuild the house in the 1980s were not realized because of the expense of the undertaking. A large lot with the ruins on it eventually became part of the subdivision plan.