The house was built by builder and contractor, Charles Osborne Luff, for himself in 1903. At the same time Luff built the house next door at number 17 for the Rev David Meadowcroft.  Both houses occupied land previously the site of a large wooden house.  Luff was at one time a member of the Richmond Council.

By 1906 Luff had moved out and the new owner was William Henry Pither, investor, who that year married Emma Stone at St Peter’s, Eastern Hill.  The couple remained there until William’s death in 1943, followed by Emma’s death in 1948.  The couple had no children. 

The next owner was Richard William Percy Stone who rented the house to tenants. By 1960 he had sold to the Missionary Sisters of the Sacred Heart of Jesus, who had already acquired the hospital next door at 29 Simpson Street, then known as Mena House.