The house first appears in the Rate Books in 1869 as a four roomed brick house and lists William Walker as owner. The Argus tells us that 'On the 23rd inst. (May 1872), at Morpeth Villa, Agnes Street, Jolimont, Mrs. William F. Walker [had] a son.' William Walker and his family lived in the house until 1875, but he remained owner until 1886. Morpeth was the place in Northumberland where the Walker family orginated. 

An Auction advertisement in the Argus in 1877 described it as, 'containing five good rooms, kitchen and servants' room, with bathroom, washhouse, pantry and cellar, verandah back and front; also stable and coachhouse at rear.' Apparently it did not sell.

William F. Walker was appointed Commissioner of Customs in 1878, and was a part owner of the Waratah Lime, Marble and Cement Company. Walkerville (previously Waratah) in Gippsland is named after him. He died in 1890, aged 48.

Thomas Harte, post office official, bought the house in 1887. He died two years later and his wife, Eliza, became the owner. She continued to live there until her own death in 1899. The Statement of Assets in Thomas Harte's probate described the house as six rooms plus kitchen and bathroom. It was valued at 950 pounds. Ten years later Eliza's Statement of Assets quoted it at 700 pounds.