People often fall under the spell of the "more is better" assumption when it comes to supplements, but, while B6 (pyridoxine) has many lifesaving applications (e.g., treating a specific type of seizure, or [protecting the system from acute neurotoxicity of chemotherapeutic agents, B6 can be downright toxic in high concentrations.
Patients with abnormally elevated B6 levels were found to experience numbness and burning pain among other symptoms. A patient who ingested on the order of 10 grams per day over the long term was found to have muscle weakness and motor deficits in addition to sensory neuropathy.
The most famous anecdote of this was in Oliver Sacks "The Man Who Mistook His Wife for a Hat" under the story entitled "The Disembodied Lady", where a prolonged megadose of B6 left a woman with no proprioceptive feedback about her body in space. Certainly, there is little or no data about her actual ingested amounts in the popular press account, but this effect was seen frequently as a result of bodybuilding fads in the 1970s and 1980s.
So, the very act of taking the supplement in excess can exacerbate an existing neuropathic condition, or potentially create a pathology where none was present beforehand.
B12 (often supplemented as cyanocobalamin) is a bit of a different animal. It requires a cofactor ("intrinsic factor") to be absorbed properly, so it's more difficult to inadvertently take in excess.