When they explained it they said that he only sends the part of his body that overlaps with the opponent in the Kamui dimension. If he sent his entire body there that wouldn't be Kamui intangibility but instead just heading to the Kamui dimension like where he fought Kakashi.His body is literally in another world. There is nothing attached to his shadow there.