We propose and analyze an efficient high-dimensional quantum state transfer protocol in an XX coupling spin network with a hypercube structure or chain structure. Under free spin wave approximation, unitary evolution results in a perfect high-dimensional quantum swap operation requiring neither exteal manipulation nor weak coupling. Evolution time is independent of either distance between registers or dimensions of sent states, which can improve the computational efficiency. In the low temperature regime and thermodynamic limit, the decoherence caused by a noisy environment is studied with a model of an antiferromagnetic spin bath coupled to quantum channels via an Ising-type interaction. It is found that while the decoherence reduces the fidelity of state transfer, increasing intra-channel coupling can strongly suppress such an effect. These observations demonstrate the robustness of the proposed scheme.