A rate dependent crystal plasticity constitutive model considering self and latent hardening in finite element analysis was developed to simulate rolling textures of pure aluminum. By changing the assignment of orientations to finite elements, i.e. assigning the same set of orientations to all elements or different orientations to different elements, the influences of grain interaction on the formation of rolling textures were numerically simulated with this kind of crystal plasticity finite element model. The simulation results reveal that the grains without considering grain interaction rotate faster than those considering grain interaction, and the rotation of grain boundary is slowed down due to the grain interaction. For a good simulation more elements should be assigned to one grain, in which the effects of both the boundary and interior parts of grain contribute to the formation of rolling textures.