The objective of this paper is to study the residual ultimate strength of box beams with impact-induced damage, as a model of what may occur in ship hulls. The bottom and side plates of ship hulls can suffer denting or fracture damage due to grounding, collision and other contacts during the ship's service life and these impact-induced damages could result in considerable strength degradation. Box beams are firstly subjected to impact loading and then four-point bending loading is imposed on the damaged structures to assess the residual strength using ANSYS/LS_DYNA. The ultimate moment and collapse modes are discussed considering the effect of impact location. The impact-induced deformation is introduced in the four-point bending simulation, and the impact-induced stress is included or not to determine the effect of residual stress and distortion after impact. It is shown that impact location has significant influence on the residual ultimate bending moment of the damaged box beam providing that the impact energy is kept constant. The collapse modes also change when the impactor strikes on different locations. Damaged hard corner and inclined neutral axes might explain the reduction of ultimate strength and diverse collapse modes. The residual stress in the box beam after impact may increase or decrease the ultimate strength depending on impact location.