The current building replaced an ancient chapel. It was built between 1792 and 1797 to the designs of architect Thomas Gardner for the residents of Richard Arkwright’s mill in Cromford. Grade I listed.
Although Willersley Castle was built for Sir Richard Arkwright, he never in fact got to live there. During construction it was gutted by fire in 1791, and Arkwright was dead by the time it could be completed. See http://en.wikipedia.org/wiki/Willersley_Castle