The house was built by the Ambler family who maintained a farm outside of town where they grew various crops. In the 1960's, a business located here painted the building pink and it has been known by locals ever since as the "Pink" House. The house was repainted yellow in the late 1990's.