Laboratory batch experiments were conducted to study Arsenic (As) removal from a naturally contaminated soil using phosphoric acid (H3PO4) and potassium dihydrogen phosphate (KH2PO4). Both H3PO4 and KH2PO4 proved to clearly reduce toxicity of the soil in terms of soil As content, attaining more than 20% As removal at a concentration of 200 mmol/L, although soil As tolerance limit of 30 mg/kg, according to Chinese Environmental quality standard for soil (EQSS), was not satisfied by using these two extractants. At the same time, acidification of soil and dissolution of soil components (Ca, Mg, and Si) resulted from using these two extractants, especially H3PO4. The effectiveness of these two extractants could be attributed to the replacement of As by phosphate ions (PO43-). The function of H3PO4 as an acid to dissolve soil components had little effects on As removal. KH2PO4 almost removed as much As as H3PO4, but it did not result in serious damage to soils, indicating that it was a more promising extractant. The results of a kinetic study showed that As removal reached equilibrium after incubation for 360 min, but dissolution of soil components, especially Mg and Ca, was very rapid. Therefore dissolution of soil components would be inevitable if As was further removed. Elovich’s model best described the kinetic data of As removal among the four models used in the kinetic study.