Anchoritess

A female anchorite; a woman who withdraws from society to live in religious isolation.

From anchorite + -ess (feminine suffix from Old French/Latin). The suffix -ess was added to mark the feminine form of the traditionally male religious role.