Joseph was born on the moorland farm at Norland, above Halifax, West Yorkshire. The farm still exists and is managed by John Kitson son of the rugby player George Kitson. Joseph went on to farm at Siddal nr Halifax and died in Siddal Hall where most of the family lived