In the design of a BeiDou navigation satellite system(BDS) receiver, the carrier loop is largely influenced by the loop filter, and the selection of loop filter parameters is crucial to the performance of the carrier loop. In this paper, by analyzing the relationship between the parameters of the loop filter transfer function of the BDS receiver's fourth-order carrier loop system and the time-domain index of the system, the loop filter transfer function parameters of the fourth-order system are obtained when the dynamic performance is best optimized under the condition that the maximum steady-state error is limited. The relationship between the phase margin, magnitude margin of the system and the parameters of the system transfer function is obtained through simulation experiment and theoretical derivation. The simultaneous equations of deriving the loop system transfer function parameters are given under the following conditions:the optimal phase margin and magnitude margin of the system are settled. These research results have important reference significance for the design of a high-performance BDS receiver.