In 1923, the first memorial (a vault) was erected in the Markdale Public Cemetery. Interested citizens arranged for three large stone plaques which listed the names of the men from Markdale who joined the active forces. One plaque listed the 33 names of those who paid the supreme sacrifice in the First World War. The remaining two plaques listed the 142 names of those who joined the forces in Markdale and were fortunate enough to return home.
The Royal Canadian Legion was founded in 1925-26 and Veterans paraded to the cemetery on November 11 for their service honouring the First World War Veterans. In 1971, the vault was removed and a new one was erected further back in the cemetery grounds. Its placement was questioned and through the efforts of a local Veteran, who is now deceased, the three plaques were carefully taken down and stored at the Royal Canadian Legion Headquarters. A smaller brass plaque was created and erected in the Carnegie Library and still hangs to this day.
The same local Veteran and his committee began fundraising and sought approval from the local hospital to erect a new memorial to honour the men and women from the First and Second World Wars and the Korean War. Through hard work and the approval from the Centre Grey Hospital Board for land, a new memorial was constructed and placed on the Southeast corner of the hospital in 1979. In 1983, the Hospital Board gave approval for more ground to be given to install the three plaques with the First World War Veterans, behind the existing memorial. The new memorial was moved to its current location at the Royal Canadian Legion - Branch 333 Flesherton-Markdale.
