Ta2O5 films are prepared on Si, BK7, fused silica, antireflection (AR) and high reflector (HR) substrates by electron beam evaporation method, respectively. Both the optical property and laser induced damage thresholds (LIDTs) at 1064 nm of Ta2O5 films on different substrates are investigated before and after annealing at 673 K for 12 h. It is shown that annealing increases the refractive index and decreases the extinction index, and improves the O/Ta ratio of the Ta2O5 films from 2.42 to 2.50. Moreover, the results show that the LIDTs of the Ta2O5films are mainly correlated with three parameters: substrate property, substoichiometry defect in the films and impurity defect at the interface between the substrate and the films. Details of the laser induced damage models in different cases are discussed.