The dynamics of the quantum Fisher information (QFI) of phase parameter estimation in a non-Markovian dissipative qubit system is investigated within the structure of single and double Lorentzian spectra. We use the time-convolutionless method with fourth-order perturbation expansion to obtain the general forms of QFI for the qubit system in terms of a non-Markovian master equation. We find that the phase parameter estimation can be enhanced in our model within both single and double Lorentzian spectra. What is more, the detuning and spectral width are two significant factors affecting the enhancement of parameter-estimation precision.