Sign languages rely on the use of space (locations, motions, and handshapes) to express meaning or grammatical nuance, or both. This use of space for the sake of language is neurologically distinct from spatial processing in general; in fact, it appears to be located in the opposite hemisphere of the brain.
A team of California researchers found in 1998 that native signers with damage to particular regions of their left hemispheres had impaired use of space for grammatical purposes, but could draw and copy diagrams normally. Conversely, native signers with right-hemisphere damage could not copy drawings well, but their use of space in their signing was entirely intact. The key appears to be that the primary language-areas of the brain are localized to the left hemisphere regardless of whether the language being processed is auditory or visual.