To cancel or remove a membership, suspend the member. The suspended member becomes a regular non-member contact, but with their membership information archived in case you want to restore their membership at some point. The suspended member can reapply for membership at any time, and can register for unrestricted events. The suspended member can log in, but as a non-member contact.
For more information, see Suspending a member.