Challenging a hole to move through an ordered insulator