To understand the enhancing effect and fiber-reinforced mechanism of composite fibers reinforced cement concrete, the influences of composite fibers on micro-cracks and the distribution of composite fibers were evaluated by optical electron micrometer (OEM) and scanning electron microscope (SEM). Three kinds of fiber, such as polyacrylonitrile-based carbon fiber, basalt fiber, and glass fiber, were used in the composite fibers reinforced cement concrete. The composite fibers could form a stable structure in concrete after the liquid-phase coupling treatment, gas-liquid double-effect treatment, and inert atmosphere drying. The mechanical properties of composite fibers reinforced concrete (CFRC) were studied by universal test machine (UTM). Moreover, the effect of composite fibers on concrete was analyzed based on the toughness index and residual strength index. The results demonstrated that the composite fibers could improve the mechanical properties of concrete, while the excessive amount of composite fibers had an adverse effect on the mechanical properties of concrete. The composite fibers could significantly improve the toughness index of CFRC, and the increment rate is more than 30%. The composite fibers could form a mesh structure, which could promote the stability of concrete and guarantee the excellent mechanical properties.