The energy of light exposed on human skin is compulsively limited for safety reasons which affects the power of photoacoustic (PA) signal and its signal-to-noise ratio (SNR) level. Thus, the final reconstructed PA image quality is degraded. This Letter proposes an adaptive multi-sample-based approach to enhance the SNR of PA signals and in addition, detailed information in rebuilt PA images that used to be buried in the noise can be distinguished. Both ex vivo and in vivo experiments are conducted to validate the effectiveness of our proposed method which provides its potential value in clinical trials.