Hyperthermia is a promising method to enhance chemo and radiation therapy of breast cancer. In the process of hyperthermia, temperature monitoring is of great importance to assure the effectiveness of treatment. The transmission speed of ultrasound in biomedical tissue changes with temperature. However, when mapping the speed of sound directly to temperature in each pixel as desired for using all speeds of ultrasound data, temperature bipolar edge enhancement artifacts occur near the boundary of two tissues with different speeds of ultrasound. After the analysis of the reasons for causing these artifacts, an optimized method is introduced to rebuild the temperature field image by using the continuity constraint as the judgment criterion. The significant smoothness of the rebuilding image in the transitional area shows that our proposed method can build a more precise temperature image for controlling the medical thermal treatment.