Active replication is an effective means to enhance fault tolerant capability in distributed systems. A fault-tolerant group is composed of replicas of key components in a system. This paper analyzes three types of leave semantics of group members, and manifests activities a group member involves. Then it educes requirements for a group member to safely leave. As to quick-leave semantics, this paper proposes a solution and discusses the non-empty protocol and relay protocol in detail. Further, it gives proofs of correctness and termination property of the protocols. The solution is a building block for a practical and operational group membership module.