Here, we designed a broadband, low loss, compact, and fabrication-tolerant silicon-based four-mode edge coupler, composed of a $1\times 3$ adiabatic mode-evolution counter-taper splitter and a triple-tip inverse taper. Based on mode conversion and power splitting, the proposed structure can simultaneously realize efficient mode coupling from ${\mathrm{TE}}_0$, ${\mathrm{TM}}_0$, ${\mathrm{TE}}_1$, and ${\mathrm{TM}}_1$ modes of multimode silicon waveguides to linearly polarized (LP), ${\mathrm{LP}}_{01,\mathrm{x}}$, ${\mathrm{LP}}_{01,\mathrm{y}}$, ${\mathrm{LP}}_{11\mathrm{a},\mathrm{x}}$, and ${\mathrm{LP}}_{11\mathrm{a},\mathrm{y}}$, modes in the few-mode fiber. To the best of our knowledge, we proposed the first scheme of four LP modes coupling, which is fully compatible with standard fabrication process. The 3D finite-difference time-domain simulation results show that the on-chip conversion losses of the four modes remain lower than 0.62 dB over the 200 nm wavelength range, and total coupling losses are 4.1 dB, 5.1 dB, 2.1 dB, and 2.9 dB for ${\mathrm{TE}}_0\text{-to-}{\mathrm{LP}}_{01,\mathrm{x}}$, ${\mathrm{TM}}_0\text{-to-}{\mathrm{LP}}_{01,\mathrm{y}}$, ${\mathrm{TE}}_1\text{-to-}{\mathrm{LP}}_{11\mathrm{a},\mathrm{x}}$, and ${\mathrm{TM}}_1\text{-to-}{\mathrm{LP}}_{11\mathrm{a},\mathrm{y}}$, respectively. Good fabrication tolerance and relaxed critical dimensions make the four-mode edge coupler compatible with standard fabrication process of commercial silicon photonic foundries.