The house passed hands to Manhattan dermatologist Toyohiko Campbell Takami, whose family resided in it for over 50 years and from whom CSHL purchased it in 1973. Afterward, the house was named in honor of Robert H.P. Olney, who successfully led the Long Island Biological Association fund drive, which had a goal of $250,000. After in-house restoration, the ground floor formed an apartment for a staff member's family, and the two upper floors provided rooms for unmarried staff and summer visitors.