Paper The following article is Open access

Long-term performance of Utah slanted electrode arrays and intramuscular electromyographic leads implanted chronically in human arm nerves and muscles

, , , , , and

Published 28 October 2020 © 2020 The Author(s). Published by IOP Publishing Ltd
, , Citation Jacob A George et al 2020 J. Neural Eng. 17 056042 DOI 10.1088/1741-2552/abc025

1741-2552/17/5/056042

Abstract

Objective. We explore the long-term performance and stability of seven percutaneous Utah Slanted Electrode Arrays (USEAs) and intramuscular recording leads (iEMGs) implanted chronically in the residual arm nerves and muscles of three human participants as a means to permanently restore sensorimotor function after transradial amputations. Approach. We quantify the number of functional recording and functional stimulating electrodes over time. We also calculate the signal-to-noise ratio (SNR) of USEA and iEMG recordings and quantify the stimulation current necessary to evoke detectable sensory percepts. Furthermore, we quantify the consistency of the sensory modality, receptive field location, and receptive field size of USEA-evoked percepts. Main results. In the most recent subject, involving USEAs with technical improvements, neural recordings persisted for 502 d (entire implant duration) and the number of functional recording electrodes for one USEA increased over time. However, for six out of seven USEAs across the three participants, the number of functional recording electrodes decreased within the first 2 months after implantation. The SNR of neural recordings and electromyographic recordings stayed relatively consistent over time. Sensory percepts were consistently evoked over the span of 14 months, were not significantly different in size, and highlighted the nerves' fascicular organization. The percentage of percepts with consistent modality or consistent receptive field location between sessions (∼1 month apart) varied between 0%–86.2% and 9.1%–100%, respectively. Stimulation thresholds and electrode impedances increased initially but then remained relatively stable over time. Significance. This work demonstrates improved performance of USEAs, and provides a basis for comparing the longevity and stability of USEAs to that of other neural interfaces. USEAs provide a rich repertoire of neural recordings and sensory percepts. Although their performance still generally declines over time, functionality can persist long-term. Future work should leverage the results presented here to further improve USEA design or to develop adaptive algorithms that can maintain a high level of performance.

Export citation and abstract BibTeX RIS

1. Introduction

The Utah Slanted Electrode Array (USEA) consists of a 10 × 10 grid of electrodes with depths from 0.5–1.5 mm that penetrate peripheral nerves to enable single-unit neural recordings and intraneural microstimulation [1]. USEAs implanted in the peripheral nerves serve as a bi-directional sensorimotor neural interface, and have now been used to reanimate motionless limbs [2, 3], to provide intuitive control of and sensory feedback from bionic arms [49], and to alleviate neuropathic pain [10, 11]. The high electrode count and intrafascicular nature of the USEA yields improved specificity [6, 12]. However, the long-term viability of chronically implanted USEAs has been uncertain [13] given the inconsistent long-term performance in cats [14].

The long-term viability of USEAs implanted in humans has become increasingly important as the field of neural prostheses moves rapidly towards clinical translation, with a current emphasis on multi-year, unsupervised, take-home trials [1517]. Work with four prior human amputee subjects demonstrated short-term (< 5 weeks) viability of USEAs as a sensorimotor interface for neural prostheses [7, 8]. The present study extends these prior works by increasing the study duration well beyond 5 weeks and by providing additional data and performance analysis from iEMGs implanted in three new subjects. We quantify, for the first time, the long-term performance of USEA and iEMGs implanted in humans as a chronic sensorimotor neural interface for neural prostheses. We also highlight across-subject improvements in performance associated with technological advances in USEA design and showcase the longest duration of single-unit neural recordings from human peripheral nerve to date (502 d).

2. Methods

2.1. Human subjects

We implanted USEAs and iEMGs into the residual arm nerves and muscles of three transradial amputees for neural recording and stimulation and recording muscle signals, respectively. The first participant (subject 5; S5) was a 43-year-old male whose left and right forearms were amputated 24 years prior due to trauma [9, 18]. The second participant (subject 6; S6) was a 57-year-old male whose left foot and left forearm were amputated 13 years prior due to trauma [5, 6, 10, 12]. The third participant (subject 7; S7) was a 48-year-old male whose right forearm was electively amputated due to chronic complex regional pain syndrome (CRPS) with simultaneous intraoperative implantation of the USEA and iEMG devices [4, 5]. Results for participants S1–S4 have been reported previously [7, 8], and are not reported herein.

All amputee participants were evaluated by a physician and psychologist for their willingness and ability to participate in the study. All surgeries and experiments were performed with informed consent from the participants and following protocols approved by the University of Utah Institutional Review Board and the Department of Navy Human Resources Protection Program. An investigation device exemption (IDE) was not required for the experiments described herein based on IDE regulation 21CFR812.3(h) that defines research subject to IDE requirements. The primary research associated with the implanted devices was intended to be 'basic research of the nervous system' conducted to understand the physiology of the nervous system and not to evaluate the safety or efficacy of a medical device. The University of Utah Institutional Review Board concurred and allowed us to conduct the study.

2.2. Implanted devices

We implanted two USEAs each in S5 and S6 (one in the median nerve and one in the ulnar nerve), and three USEAs in S7 (two in the median nerve and one in the ulnar nerve), as described in [5] (figure 1). All USEAs were implanted midway along the upper arm, proximal to the medial epicondyle and to many motor branch points, thereby providing access to muscle proprioceptive afferents from muscle spindles and Golgi tendon organs. For S7, one median-nerve USEA (S7-M1) was implanted more proximal and on the anterior side of the nerve under the dissected epineurium. The other median-nerve USEA (S7-M2) was implanted more distal and on the posterior side of the nerve under the dissected epineurium (i.e. the opposite side of the nerve relative to where the epineurium had been dissected open). The two USEAs were orientated in opposite directions relative to the nerve, such that the short electrodes were distal for one array and the long electrodes were distal for the other array (figure 2). After the dissected epineurium was sutured closed, the nerve was wrapped with an AxoGuard nerve wrap (AxoGen Inc. Alachua, FL, USA) to provide additional mechanical stability. A summary of the implanted devices can be found in table 1.

Figure 1.

Figure 1. Overview of implanted devices. (A) USEAs and iEMGs were implanted into three transradial amputees to restore sensorimotor function. (B) USEAs were implanted into the residual median and ulnar nerves. (C) iEMGs were implanted into the residual extrinsic hand muscles. Devices from S7 are shown. Images adapted from [5].

Standard image High-resolution image
Figure 2.

Figure 2. Surgical placement of USEAs in the median nerve of participant S7. S7-M1 was implanted more proximal and on the anterior side of the nerve under the dissected epineurium. S7-M2 was implanted more distal and on the posterior side of the nerve under the dissected epineurium. The two USEAs were orientated in opposite directions relative to the nerve, such that the short electrodes were distal for one array and the long electrodes were distal for the other array. After implantation, the epineurium was sutured back together and the nerve was wrapped with an AxoGuard nerve wrap (AxoGen Inc. Alachua, FL, USA) to provide additional mechanical stability.

Standard image High-resolution image

Table 1. Human subjects and implanted devices.

Participant IDAmputationStudy durationDevice IDImplanted nerve
S5Left transradial, 24 years prior84 dS5-MMedian
S5-UUlnar
S6Left transradial, 13 years prior425 dS6-MMedian
S6-UUlnar
S7Right transradial, during implant503 dS7-M1Median
S7-M2Median
S7-UUlnar

USEAs are silicon microelectrode arrays, with 100 electrode shafts, arranged in a 10 × 10 grid on a 4 mm × 4 mm base. Electrode shafts are spaced 400 μm apart, with shaft lengths varying from approximately 0.5–1.5 mm [1]. Four looped platinum wires were also implanted—two served as electrical ground and stimulation return, and two served as reference wires for recording.

All USEA tip metallization was performed by Blackrock Microsystems (Salt Lake City, UT, USA), using metallizations developed with support from the Defense Advanced Research Projects Agency's Hand Proprioception and Touch Interfaces program. USEAs for S5 and S6 were tip-metalized with a pure platinum adhesion layer. USEAs for S7 were tip-metalized with a platinum silicide co-sputtered adhesion layer and utilized a more rapid annealing process. USEAs for S5 featured straight-connection wire bundles, whereas USEAs for S6 and S7 featured helical wire bundles intended to provide strain relief and reduce wire breakage. For S7, the helix was extended all way into the connector system, and additional silicone mechanical support was added to further reduce wire breakage [19].

All participants were also implanted with eight iEMG leads (with four contacts each) for a total of 32 electrode sites, with attempted targeting of each lead to different lower-arm extensor or flexor muscles. A separate iEMG lead (with two contacts) was implanted proximal and posterior to the elbow to provide an electrical reference and ground (Ripple Neuro LCC, Salt Lake City, UT, USA). Both USEA and iEMG electrodes exited the arm through a percutaneous incision and were mated with external Gator Connectors and associated Front Ends (Ripple Neuro LLC) for filtering and amplifying signals and for delivering stimulation.

USEAs and iEMGs were surgically removed after 84 d for participant S5 due an infection at the USEA percutaneous wire passage site. S5 recovered fully after USEA extraction and antibiotic treatment. USEAs and iEMGs were surgically removed after 425 d and 503 d for participants S6 and S7, respectively, as the result of prior mutual agreements between the volunteer participants and the experimenters regarding study duration. The nerve remained intact after the USEAs were surgically removed; no segments of the nerve were excised. Because USEAs were implanted in still-functioning nerve innervating residual forearm muscles and skin, histology was not performed on the nerves before USEAs were implanted or after the USEAs were explanted. Prior work has documented the histological response to implanted USEAs using nearly the same devices and implantation procedure described herein [20].

2.3. Electrode impedance

Electrode impedance was measured at 1 kHz and 10 nA with respect to the platinum ground wires using Trellis software (Ripple Neuro LLC). Impedances were measured at the start of each experimental session. We define functionally connected electrodes as electrodes with an impedance below 500 kΩ. Prior work has shown that USEA electrode impedances are relatively bi-modal, with one distribution under approximately 200 kΩ and the other above approximately 1 MΩ [19]. Thus, the relatively high 500-kΩ threshold likely provides an overestimate of functionally connected electrodes for relatively low-impedance USEA electrodes, but has been utilized previously [7]. Non-functionally connected electrodes are assumed to be electrodes with wires that are broken outside of the human body. Wires are assumed to be physically broken because transitions from low impedance (<200 kΩ) to high impedance (>1 MΩ) are abrupt with Utah Arrays implanted in the peripheral nerves, whereas increases in impedance due to inflammatory responses or neuron damage take place over an extended period time (as observed for Utah Arrays with a more stable environment in cortex [21]). Breaks are assumed to be outside of the human body because broken wires have been physically observed in the extracorporeal portion of the helical wire bundle, and broken wires in saline have an impedance under 200 kΩ [22].

2.4. Recording datasets

During each session, participants were instructed to perform three different sets of movements for 10 s each, one after another, as described in [23]. These sets of movements were: (1) individual digit movements (isolated flexion and extension of D1–D5), (2) grasping (simultaneous flexion and extension of D1–D5), and (3) wrist movement (rotation, flexion/extension, and radial/ulnar deviation). These three sets of movements were performed one after another, and were then followed by a 10-s rest period where participants were instructed to relax and minimize their muscle activity. Only the middle 8 s of each set of movements was analyzed to avoid transition delays due to participant reaction time. A total of 13, 65, and 46 datasets were collected for participants S5, S6, and S7, respectively. Additional experimental sessions were performed with the participants and have been reported previously [46, 9, 10, 12].

2.5. Neural recordings

Neural recordings were sampled at 30 kHz using the Grapevine Neural Interface Processor (Ripple Neuro LLC). Neural recordings were band-pass filtered with a 0.3 Hz first-order high-pass Butterworth filter and a 7500 Hz third-order low-pass Butterworth anti-aliasing filter. A digital high-pass filter with a cut-off frequency of 250 Hz (fourth-order Butterworth filter) was also applied to neural recordings.

Neural activity was detected by threshold crossings of an automated threshold set to negative five times the standard deviation of the electrode recordings during the rest period, as previously outlined in [8]. Threshold crossings were analyzed offline in MATLAB (MathWorks, Natick, MA, USA) to identify neural units. We defined neural units as a collection of threshold crossing events from a single electrode that have similar waveform shapes [21]. As noted in [21], neural units could be single-neuron action potentials, multi-neuron activity without well-isolated action potential shapes, or a collection of indistinct low-amplitude threshold crossings. For each threshold crossing, the voltage waveform was saved from the previous 100 µs to the subsequent 600 µs. Waveforms were designated as noise and manually removed from the data on the basis of visually non-overlapping outlier waveforms with interspike interval distributed around 60 Hz, 120 Hz or 180 Hz. We did not attempt to sort or distinguish among the remaining, non-noise waveforms. Thus, all analyses were performed at an electrode level, as opposed to an individual neuron level.

Functional recording electrodes were defined as electrodes that have five times more threshold crossings during any of the three movement periods or rest period than the average number of threshold crossings across all electrodes during the rest period. Neural signal-to-noise ratio (SNR) was defined as the mean peak-to-peak value divided by two times the standard deviation during the rest period [8]. Because of the spike detection threshold (negative five times the standard deviation during rest), there is a lower limit of 2.5 for the SNR.

2.6. EMG recordings

EMG recordings were sampled at 1 kHz using the Grapevine Neural Interface Processor. EMG recordings were band-pass filtered with cut-off frequencies of 15 Hz (sixth-order high-pass Butterworth filter) and 375 Hz (second-order low-pass Butterworth filter). Notch filters were also applied at 60 Hz, 120 Hz, and 180 Hz. EMG SNR was calculated in decibels as 20 times the root mean square of the EMG recordings during the three movement periods divided by the root mean square of the EMG during the rest period.

2.7. Neural stimulation

Intraneural microstimulation was delivered via USEAs using the Grapevine Neural Interface Processor. All stimulation was delivered as biphasic, charge-balanced, cathodic-first pulses, with 200-µs phase durations, and a 100-µs interphase duration. Stimulation was delivered through individual USEA electrodes one by one. Stimulation was delivered in a pulsed fashion, with a 500-ms train of 100 Hz stimulation being delivered every second. Stimulation current varied between 1–100 µA.

2.8. USEA-evoked percepts

For S5 and S6, we mapped the location, modality and detection threshold of the USEA-evoked percepts over time. Detection thresholds were identified by increasing stimulation current in 1–10 µA steps until a sensation was reliably detected. The pulse width (200-µs phase durations) was fixed such that the total charge delivered was only a function of stimulation current. Participants reported the percept location by drawing the receptive field on an image of a hand. Receptive fields were then assigned to hand locations, corresponding with the five digits and anterior and posterior regions of the hand. The hand locations were based on the sensor locations of the LUKE Arm prosthesis (DEKA, Manchester, NH, USA), and included the following: thumb, index, middle, ring, pinky, median palm, ulnar palm, and back of hand. Participants also selected the modality of the percepts from the following options: Vibration, Tightening, Tapping, Flutter, Pressure, Pain, Buzzing, Skin Stretch, or Proprioception (movement).

Mappings were completed at 15 d, 45 d, and 62 d post-implant for S5-M and at 20 d, 55 d, and 83 d post-implant for S5-U. For S6-M, mappings were completed at 11 d, 54 d, 83 d, 138 d, 173 d, 208 d, 242 d, 298 d, and 342 d post-implant. For S6-U, mappings were completed at 17 d, 55 d, 83 d, 138 d, 173 d, 208 d, 242 d, 298 d, and 354 d post-implant.

Extensive mappings were not collected with S7 because of a narrow window of current between percept detection and discomfort (potentially due to pre-existing long-term CRPS) [4]. Neural stimulation with S7 was limited to less than 10 USEA electrodes initially, and then no longer performed entirely at the request of S7. A maximum of 0.4 mC of charge was delivered through S7's USEAs over the span of 503 d. In contrast, a maximum of 1.3 mC and 19 mC of charge was delivered for S5 and S6 over the span of 84 d and 425 d, respectively.

2.9. Percept stability

We defined functional stimulating electrodes as electrodes that reliably evoked a detectable percept using stimulation currents below 100 µA. Electrodes that did not evoke a percept below 100 µA were not included in the stability analyses. To quantify stability of percept locations and percept modalities, we compared the percept location or modality for each electrode at adjacent timepoints. We define the percentage of stable electrodes between timepoints as the number of electrodes with consistent location or modality between the current timepoint and the previous timepoint out of the total number of electrodes that evoked sensations at both timepoints.

2.10. Statistical analyses

Because data were not normally distributed (Lilliefors), we performed a one-way non-parametric ANOVA (Kruskal–Wallis) for each USEA to determine if detection threshold or electrode impedance changed significantly between datasets (i.e. time as the sole factor and each USEA being an independent entity). If significance was found, we performed subsequent multiple comparisons (Wilcoxon rank-sum test) using adjusted alpha levels based on the Dunn-Šidák correction for multiple comparisons. Each individual comparison between timepoints was performed in an unpaired manner. Paired comparisons for electrodes were not performed because the number of overlapping electrodes between timepoints was much smaller than the total number of electrodes at each timepoint.

2.11. Correlation analyses

We quantified the correlation among the three pairs of variables using the Pearson's correlation coefficient: (1) the number of functionally connected electrodes over time and the number of functional recording electrodes over time, (2) the number of functional stimulating electrodes over time and the number of functional recording electrodes over time, (3) the number of functionally connected electrodes over time and the number of functional stimulating electrodes over time. Because there were more datapoints for functional recording electrodes over time, we down-sampled the number of functional recording electrodes to the timepoints closest to when measurements were taken for functionally connected electrodes and functional stimulating electrodes. Thus, correlations were performed among pairs of three, nine and four datapoints for S5, S6 and S7, respectively.

3. Results

3.1. The number of functionally connected electrodes decreased over time for the first two of three participants, but not the third

The number of functionally connected electrodes (i.e. electrodes with an impedance under 500 kΩ) during the first sessions post-implant was 82 for S5-M, 71 for S5-U, 80 for S6-M, and 86 for S6-U, 82 for S7-U, 89 for S7-M1, and 56 for S7-M2. The number of functionally connected electrodes declined over time for USEAs implanted in S5 and S6. Importantly, however, for S7 and the latest iteration of USEA improvements, the number of functionally connected electrodes remained relatively constant for S7-U and S7-M1, and apparently increased over time for S7-M2 (figure 3(A)), perhaps due to an earlier temporarily faulty external connection or an increase in capacitive coupling or shunting. The general improvement in the number of functionally connected electrodes across subjects is likely the result of the extended helical wire bundle and additional silicone mechanical support associated with the USEAs implanted in S7 [19], which presumably reduced lead-wire breakage and delamination at the bond pads of the USEA.

Figure 3.

Figure 3. Impedance of functionally connected USEA electrodes over time. Timepoints are shown for each experimental session (ordinal scale). (A) Functionally connected electrodes are defined as electrodes with an impedance below 500 kΩ. The number of functionally connected electrodes declined over time for USEAs implanted in S5 and S6, but maintained relatively constant for USEAs implanted in S7. (B) Impedances of functionally connected electrodes were relatively stable over time. Black circles show median, thicker colored bars show IQR, thinner colored bars extend to the most extreme non-outlier values and open circles show outliers more than 1.5 times the IQR. * denotes statistically significant difference relative to a subsequent timepoint (p < 0.05, multiple unpaired comparisons with correction). S5-M: no significant differences. S5-U: day 20 and day 55 significantly different from day 83. S6-M: day 11 significantly different from days 83, 208 and 242. S6-U: day 17 significantly different from day 55; day 55 significantly different from days 173, 242, 298, and 342; day 83 significantly different from days 242 and 342. S7-U: day 18 significantly different from days 52, 192, and 502; day 52 significantly different from day 192; day 192 significantly different from day 502. S7-M1: days 18, 52 and 192 significantly different from day 502. S7-M2: day 18 significantly different from days 192 and 502.

Standard image High-resolution image

3.2. Electrode impedance varied over time

Electrode impedances varied over time, with significant differences often occurring relative to the first or last session (figure 3(B)). With the exception of S5-M, electrode impedances from the first session were significantly different from impedances from at least one subsequent session (p < 0.05, unpaired Wilcoxon rank-sum test with correction for multiple comparisons). However, the direction of the change was variable for each USEA; electrode impedances during the first session were significantly higher for S6-M, S6-U, and S7-U, but significantly lower for S5-U, S7-M1, S7-M2.

The impedance and location of functionally connected electrodes on each USEA are shown in figures S1 (available online at https://stacks.iop.org/JNE/17/056042/mmedia) and S2.

3.3. The number of functional recording electrodes decreased over time for only the first two of three participants

The number of functional recording electrodes (i.e. electrodes recording neural activity) for S5 decreased from an initial 16 (at 7 d post-implant) to 1 over the 83 d study duration (figure 4). For S6, the study duration was extended and the number of functional recording electrodes decreased from an initial 20 (at 7 d post-implant) to zero within 131 d post-implant of the 425 d study duration. However, for S7, the number of functional recording electrodes remained relatively constant over the 502-d study duration. For both S5 and S6, the maximum number of functional recording electrodes (26 and 25, respectively) occurred on the second experimental session (12 d and 13 d post-implant, respectively). In contrast, the maximum number of functional recording electrodes for S7 (34) occurred on the 18th experimental session, 143 d post-implant.

Figure 4.

Figure 4. Number of functional recording electrodes over time. Timepoints are shown for each experimental session (ordinal scale). For USEAs implanted in participants S5 (green) and S6 (red), the number of functional recording electrodes decreased to zero within 130 d. For USEAs implanted in S7 (blue), the number of functional recording electrodes was greater than zero over the duration of the implant. For one USEA implanted in S7 (S7-M2, royal blue), the number of functional recording electrodes increased within the first 90 d.

Standard image High-resolution image

All three USEAs implanted in S7 continued to function up to 502 d post-implant (figure 4). However, one USEA, S7-M2, contributed the majority of functional recording electrodes for S7. Interestingly, the number of functional recording electrodes for S7-M2 increased over the first 2 months (from an initial 13 at 18 d post-implant to 31 at 88 d post-implant). In contrast, the number decreased sharply within the first 2 months for all other USEAs in S7 and the USEAs in S5 and S6.

The functional recording electrodes were distributed across the electrodes of the USEAs and corresponded to the location of functionally connected electrodes (figure 5). For S7-M2, a distinct diagonal band of functional recording electrodes was present (i.e. from ∼ E41 to ∼ E99) was also consistent with the location of functionally connected electrodes (figure S2). Some of the decreases in the number of functional recording electrodes were likely due to the reductions in functionally connected electrodes due to issues such as lead wire breakage, rather than loss of recording ability due to inflammatory responses or nerve damage (see Section 3.10).

Figure 5.

Figure 5. Percentage of sessions in which electrodes were functionally recording neural activity. Heatmaps show the 10 × 10 electrode grid on the USEA, with longest/deepest electrodes in columns 1 and shortest/shallowest electrodes in column 10. Electrodes 1, 11, 81, and 91 served as on-array references for recording. Hotter colors indicate a higher percentage of sessions in which that electrode was functionally recording neural activity.

Standard image High-resolution image

3.4. Rich repertoire of neural and EMG activity

Functional recording electrodes provided a rich repertoire of neural activity with dedicated subsets of units active primarily during unique sets of movements (figure 6). Some units were active primarily during finger movements (e.g. S7-M2, E75), others primarily during grasping (e.g.S7-M2, E64), and still others were primarily active during wrist movements (e.g. S7-U1, E55). Another subset of neural units was primarily active during rest (e.g.S7-M2, E33) whereas others were spontaneously active throughout the entire recording duration (e.g. S7-M2, E43). Importantly, individual neural units were not deterministically and uniquely related to a single movement; instead, most neural unit were still active to some degree across all three different types of movements.

Figure 6.

Figure 6. Neural units were successfully recorded long-term and were differentially recruited during different hand and wrist movements. Figure shows raster plot of neural units recorded from three USEAs (S7-M1, S7-M2, and S7-U) 502 d after they were implanted in participant S7. Vertical lines represent neural activity (i.e. threshold-crossing events). The participants were instructed to perform individual digit movements (∼0–10 s, red), grasping (∼10–20 s, yellow), and wrist movements (∼20–30 s, green), followed by a rest period (∼30–40 s, violet). Some units were active primarily during finger movements (e.g. S7-M2, E75), others primarily during grasping (e.g. S7-M2, E64), and still others were primarily active during wrist movements (e.g. S7-U1, E55). Another subset of neural units were primarily active during rest (e.g. S7-M2, E33) whereas others were spotaneously active throughout the entire recording duration (e.g. S7-M2, E43).

Standard image High-resolution image

EMG activity recorded from the extrinsic hand muscles in the residual forearm provided a robust measure of motor intent, with distinct EMG ensembles for each different movement category (figure S3). EMG activity was still present for S7 even after long-term hand disuse and muscle atrophy. Aberrant tonic activity was present on some channels—consistent with CRPS, dystonia and myoclonus [24, 25].

3.5. SNR of neural and iEMG recordings

Neural units for participants S5–S7 had characteristic waveform shapes, as shown previously for participants S1–S2 [8] (figure 7). The median (interquartile range, IQR) SNR of neural recordings was 5.74 (1.75) for S5, 5.01 (1.54) for S6, and 5.57 (2.78) for S7. The median SNR tended to reside near the lower bound of SNR (2.5) based on the threshold-crossing detection criteria (figure 8). Neural units with large outlying SNRs (more than 1.5 times the IQR greater than the upper quartile) were likely recording EMG activity correlated with motor intent, as previously noted in [26]. The SNR and location of functional recording electrodes for each USEA are shown in figure S4.

Figure 7.

Figure 7. Representative (mean SNR) neural units recorded from S7-M1. Waveforms were recorded 17 d post-implant on electrode 13 (green) and 502 d post-implant on electrode 18 (black). Forty seconds of threshold-detected waveforms are overlaid for each electrode. Each waveform is 700 µs long, with 100 µs displayed prior to threshold crossing and 600 µs shown subsequent to threshold crossing.

Standard image High-resolution image
Figure 8.

Figure 8. SNR of neural recordings over time. Timepoints are shown for each experimental session (ordinal scale). Black circles show median, thicker colored bars show IQR, thinner colored bars extend to the most extreme non-outlier values and open circles show outliers more than 1.5 times the IQR. Boxplots show the median SNRs for each functional recording electrode on that day, such that N is the number of functional recording electrodes on that day (values for N shown in figure 3). Because of the spike detection threshold (negative five times the standard deviation during rest), there is a lower limit of 2.5 for the SNR.

Standard image High-resolution image

The median (IQR) SNR of EMG recordings was 45.54 (30.72) for S5, 48.02 (18.86) for S6, and 19.98 (19.49) for S7 (figure 9). EMG SNR for S7 was significantly lower than that of S5 and S6 (p < 0.05, unpaired Wilcoxon rank-sum test with correction for multiple comparisons), likely due to S7's preexisting CRPS that resulted in multi-year hand disuse and muscle atrophy. Nevertheless, the SNR of iEMG recordings from these amputee participants was greater than the SNR of 32-channel surface EMG from intact participants using the same recording equipment (14.03 ± 4.43) [27]. iEMG recordings have also previously been reported to provide dexterous and intuitive control of bionic arms [5].

Figure 9.

Figure 9. SNR of iEMG recordings over time. Timepoints are shown for each experimental session (ordinal scale). Black circles show median, thicker colored bars show IQR, thinner colored bars extend to the most extreme non-outlier values and open circles show outliers more than 1.5 times the IQR. Boxplots show the median SNRs of the 32 iEMG electrodes for each day, such that N = 32.

Standard image High-resolution image

3.6. USEA stimulation evokes numerous cutaneous and proprioceptive percepts on the phantom hand

Intraneural microstimulation through individual USEA electrodes evoked localized sensations that were experienced on the phantom hand (figure 10). As reported previously [6], the location and modality of USEA-evoked percepts were consistent with known innervation patterns of the skin. A preponderance of percepts originated on the palmar side of the hand, and percepts were generally confined to the dermatome and myotome corresponding to the nerve in which the array was implanted. The reported modalities were also consistent with activation of cutaneous, proprioceptive and nociceptive nerve fibers. Cutaneous percepts were reported as 'Pressure' (e.g. Merkel discs), 'Tapping' or 'Flutter' (e.g. Meissner corpuscles), 'Vibration' (e.g. Meissner/Pacinian corpuscles), 'Buzzing' (e.g. Pacinian corpuscles), and 'Skin Stretch' (e.g. Ruffini endings). Proprioceptive percepts were reported as 'Tightening' (e.g. Golgi tendon organs) and 'Movement' (e.g. muscle spindles), and nociceptive percepts were reported as 'Pain' (e.g. Aδ fibers). Proprioceptive percepts evoked on the residual limb were often (∼50%) associated with a motor fiber or h-reflex activation, as evidenced by visual muscle twitches on the residual limb. In contrast, proprioceptive percepts evoked on the phantom hand were rarely (∼5%) associated with visual muscle twitches.

Figure 10.

Figure 10. Receptive fields and modality distribution of USEA-evoked percepts over time. Percepts were evoked by stimulating each USEA electrode in isolation with increasing current up to 100 µA. Participants self-reported the location of each percept by drawing the receptive field on an image of a left hand. Percepts marked off of the hand in the lower left (e.g. S5-U, 20 d post-implant) represent percepts experienced on the residual limb. Participants also self-reported the modality of each percept by selecting from nine possible modalities that corresponded to various cutaneous, proprioceptive or nociceptive sensory afferents. Each color drawn on the hand represents a different modality. Colors are transparent and overlaid such that more saturated colors represent multiple overlapping percepts with the same modality (e.g. brighter green on the palm versus faint green on D3, S5-U, 55 d post-implant). N shows the number of functional stimulating electrodes on that day and not necessarily the total number of evoked percepts; a single functional stimulating electrode would occasionally evoke multiple percepts of different modalities. Horizontal bars below each hand image show the relative distribution of modality among the evoked percepts, such that larger horizontal space dedicated to a color represents a greater percentage of percepts with the modality associated with that color.

Standard image High-resolution image

The median (IQR) percept sizes (percent of hand area) were 0.05% (0.67%) for S5-M, 2.72% (4.00%) for S5-U, 1.44% (4.14%) for S6-M, and 3.27% (6.68%) for S6-U (figure 11). The size of USEA-evoked percepts is consistent with the size of percepts evoked via longitudinal intrafascicular arrays [28]. There were no significance differences in the size of USEA-evoked percepts over time (p = 0.65 for S5-M, p = 0.07 for S5-U, p = 0.44 for S6-M, p = 0.82 for S6-U; individual one-way Kruskal–Wallis).

Figure 11.

Figure 11. Size of USEA-evoked percepts over time. Timepoints are shown for each experimental session (ordinal scale). Size is represented as the percentage of hand area. Black circles show median, thicker colored bars show IQR, thinner colored bars extend to the most extreme non-outlier values and open circles show outliers more than 1.5 times the IQR. Four outliers greater than 22% (across all USEAs) are not shown for illustrative purposes. No significant differences were found across time for each USEA (p = 0.65 for S5-M, p = 0.07 for S5-U, p = 0.44 for S6-M, p = 0.82 for S6-U; individual one-way Kruskal-Wallis).

Standard image High-resolution image

3.7. USEA-evoked percepts reveal fascicular organization of nerves

Adjacent USEA electrodes tended to evoke percepts with similar receptive fields—revealing the underlying fascicular organization of the nerve (figure 12). Electrode groupings based on receptive field were within 1–2 electrodes spacing (∼400–800 µm) and followed the orientation of the nerve (right to left on the USEA, proximal to distal on the nerve), consistent with the fascicular arrangement of human nerves [29]. For example, distinct fascicles for the thumb and middle finger were present on S6-M (figure 12, S6-M, row 2 in red and row 4 in yellow).

Figure 12.

Figure 12. Fascicular arrangement of USEA-evoked percepts over time. Percepts were evoked by stimulating each USEA electrode in isolation with increasing current up to 100 µA. Participants self-reported the location of each percept by drawing the receptive field on an image of a left hand. Percepts marked off of the hand (e.g. lower left, S5-U, 20 d post-implant) represent percepts experienced on the residual limb. Percepts were then mapped to discrete hand locations as defined by the colored hand regions in the top left. Images show the 10 × 10 electrode grid on the USEA, with longest/deepest electrodes in column 1 on the left and shortest/shallowest electrodes in column 10 on the right. Electrodes 1, 11, 81, and 91 served as on-array references for recording. The square for each electrode is colored to indicate the hand regions that the evoked percept spanned. Electrodes that evoked percepts spanning multiple hand regions are shown with multiple colors stacked vertically. Electrodes that evoked percepts that were on the residual limb or between discrete hand regions are represented by a white square. Fascicular orientation can be seen by distinct horizontal bands of color across the USEA (e.g. S6-M, red thumb region in row 2 and yellow middle finger region in row 4). Black squares show USEA electrodes that did not evoke percepts, and at early timepoints are indicative of extrafascicular regions of the nerve.

Standard image High-resolution image

3.8. Location and modality of USEA-evoked percepts were relatively stable over time

USEA-evoked percepts were relatively stable across a given pair of sessions (∼1 month) with respect to modality and receptive field location (figure 13), particularly for S6. For S6, a median of 73.9% of the percepts evoked via S6-M and a median of 100% of the percepts evoked via S6-U had consistent receptive fields between two adjacent mapping sessions. In contrast, for S5, a median of 9.1% of the percepts evoked via S5-M and a median of 39.6% of the percepts evoked via S5-U had consistent receptive fields between two adjacent mapping sessions.

Figure 13.

Figure 13. Stability of USEA-evoked percepts over time. Timepoints are shown for each experimental session (ordinal scale). Percent stable is defined as the number of electrodes with consistent location or modality between the current timepoint (dot) and the previous timepoint (line to the left) out of the total number of electrodes that evoked sensations at both timepoints. No percepts were evoked on S6-U between 83 d post-implant and 173 d post-implant.

Standard image High-resolution image

The modality of percepts was generally less stable than the receptive field location. For S6, a median of 38.8% of the percepts evoked via S6-M and a median of 0% of the percepts evoked via S6-U had consistent modalities. In contrast, for S5, a median of 27.5% of the percepts evoked via S5-M and a median of 86.2% of the percepts evoked via S5-U had consistent modalities. Interestingly however, for both S5 and S6, electrodes that evoked proprioceptive percepts consistently evoked proprioceptive percepts over time. That is, 100% of the proprioceptive percepts evoked via S5-M, S5-U, S6-M and S6-U had consistent modalities between two adjacent mapping sessions.

3.9. The number of functional stimulating electrodes decreased over time

A maximum of 113 functional stimulating electrodes (62 from S5-M and 51 from S5-U) were reported for S5. A maximum of 96 functional stimulating electrodes (64 from S6-M and 32 from S6-U) were reported for S6. For both participants, the number of functional stimulating electrodes decreased over time (figure 14(A)). Only 15 functional stimulating electrodes were present for S5 prior to explanation, and zero functional stimulating electrodes were present for S6 prior to explanation. However, the loss of functional stimulating electrodes was not monotonic; zero functional stimulating electrodes were reported for S6-U at 138 d post-implant whereas four were reported at 173 d post-implant. Some of the decreases in the number of functional stimulating electrodes was likely due to the reductions in functionally connected electrodes due to issues such as lead wire breakage, rather than loss of stimulating ability of the electrode due to inflammatory responses or nerve damage (see Section 3.10).

Figure 14.

Figure 14. Number and detection threshold of functional stimulating USEA electrodes over time. Timepoints are shown for each experimental session (ordinal scale). (A) The number of functional stimulating electrodes (i.e. electrodes with a detection threshold below 100 µA) decreased over time. (B) Detection thresholds increased over time. Detection thresholds for each electrode were identified by increasing the stimulation amplitude in 1–10 µA step sizes until a percept was reliably detected. Black circles show median, thicker colored bars show IQR, thinner colored bars extend to the most extreme non-outlier values and open circles show outliers more than 1.5 times the IQR. Boxplots show the detection thresholds of functional stimulating electrodes, such that N = the number plotted in part A at the corresponding timepoint. * denotes statistically significant difference relative to a subsequent timepoint (p < 0.05, multiple comparisons with correction). S5-M: day 15 significantly different from day 45. S5-U: day 20 significantly different than days 55 and 83. S6-M: day 11 significantly different from days 54, 83, 138, 208, 242, and 298. S6-U: no significant differences.

Standard image High-resolution image

3.10. Detection thresholds increased initially and then remained relatively stable near the upper limit

The median (IQR) detection thresholds during the first session were 25 µA (17 µA) for S5-M, 31 µA (31 µA) for S5-U, 21 µA (11 µA) for S6-M, and 36.5 µA (42.5 µA) for S6-U. In contrast, the detection thresholds during the last session with functional stimulating electrodes were 60 µA (40 µA) for S5-M, 70 µA (52.5 µA) for S5-U, 72.5 µA (25 µA) for S6-M, and 90 µA (0 µA) for S6-U (figure 14(B)). The thresholds during the first session and last session were significantly different only for S6-M (p < 0.05, unpaired Wilcoxon rank-sum test with correction for multiple comparisons). The lack of significance is likely attributed to the small sample sizes during the last session, the variability of detection thresholds within session, and the upper-limit of 100 µA. There was a significant increase from the first session to the second sessions for S5-M, S5-U, and S6-M (p < 0.05, unpaired Wilcoxon rank-sum test with correction for multiple comparisons). Functional stimulating electrodes were distributed across the electrodes of the USEAs and corresponded to the location of functionally connected electrodes (figure 15).

Figure 15.

Figure 15. Detection threshold of USEA-evoked percepts over time. Heatmaps show the 10 × 10 electrode grid on the USEA, with longest/deepest electrodes in column 1 on the left and shortest/shallowest electrodes in column 10 on the right. Electrodes 1, 11, 81, and 91 served as on-array references for recording. Hotter colors indicate a higher detection threshold. Detection thresholds for each electrode were identified by increasing the stimulation amplitude in 1–10 µA step sizes until a percept was reliably detected.

Standard image High-resolution image

3.11. The number of functionally connected electrodes, functional recording electrodes, and functional stimulating electrodes are correlated

There was a significant positive correlation among the number of functionally connected electrodes and the number of functional recording electrodes for S6-M, S6-U and for the aggregate data from all seven USEAs from S5, S6 and S7 (p < 0.05, Pearson's correlation test; figure 16). There was also a significant positive correlation among the number of functionally connected electrodes and the number of functionally stimulating electrodes for S6-M, S6-U and for the aggregate data from all four USEAs from S5 and S6 (p < 0.05, Pearson's correlation test). Lastly, there was also a significant positive correlation among the number of functional stimulating electrodes and the number of functional recording electrodes for S5-M, S6-M, S6-U and for the aggregate data from all four USEAs from S5 and S6 (p < 0.05, Pearson's correlation test).

Figure 16.

Figure 16. Correlations among the number of functionally connected, functionally recording and functionally stimulating electrodes. Individual datapoints and the line of best fit are shown for each USEA in colors indicated by the legend at the top. The aggregate line of best fit (for all datapoints) is shown in black. Pearson's correlation coefficients are shown alongside the lines of best fit. * indicates a statistically significant nonzero correlation. There was a significant positive correlation among the number of functionally connected electrodes and the number of functionally recording electrodes (left) for S6-M, S6-U and the aggregate data. There was a significant positive correlation among the number of functionally stimulating electrodes and the number of functionally recording electrodes (middle) for S5-M, S6-M, S6-U and the aggregate data. There was a significant positive correlation among the number of functionally connected electrodes and the number of functionally stimulating electrodes (right) for S6-M, S6-U and the aggregate data.

Standard image High-resolution image

4. Discussion

USEAs have now been implanted in seven human amputees with increasingly longer study durations. This work leverages multiple months of data gathered from the most recent three human participants (S5–S7) to quantify the long-term performance of USEAs as a chronic sensorimotor neural interface. Importantly, USEA recording functionality has now been empirically demonstrated out to 502 d, the longest timepoint tested. The improved long-term functionality likely arises, at least in part, from recent technical advances in the USEAs themselves.

The results presented here confirm previous findings that USEAs provide the greatest number of functionally recording and functionally stimulating electrodes among intrafascicular peripheral nerve interfaces. USEAs analyzed here were able to record neural activity from up to 34 distinct electrodes and elicit sensory percepts via intraneural stimulation from up to 113 distinct electrodes. Neural recordings have been shown to improve estimates of motor intent for bionic arms [5], and can be used to estimate motor intent when no residual muscles are available (e.g. from intrinsic hand muscles after amputation) [7]. Similarly, the ability to evoke numerous percepts corresponding to individual sensory afferents can enable biomimetic stimulation strategies at the afferent level. Recent work demonstrated that biomimetic activation of sensory afferents at the population level can improve the dexterity of bionic arms [6, 30]. We speculate that biomimetic activation at the afferent level (i.e. timed activation of the appropriate afferent types) is preferential to biomimetic activation at the population level, and would further improve dexterity. USEAs are also capable of evoking multiple proprioceptive percepts; a difficult feat for other neural interfaces that have instead relied primarily on sensory substitution for proprioceptive feedback from bionic arms [31].

However, USEAs implanted in prior participants (S3–S4) also showed a rapid loss of functional stimulating electrodes over the span of 35 d—which presented a major barrier for practical implementation and clinical translation of the aforementioned advantages of the USEA. In contrast, other peripheral nerve interfaces provide fewer electrodes but offer improved stability. For example, flat interface nerve electrodes have shown consistent receptive fields for at least five electrodes over 49 d and consistent stimulation thresholds for at least three electrodes over 476 d [32].

Similarly, transverse intrafascicular multichannel electrodes have shown consistent receptive fields for 60%–100% of nine electrode clusters over roughly 183 d and consistent stimulation thresholds for up to 46 electrodes over 175 d [33]. For two of the three participants reported in [33], the number of functional stimulating electrodes decreased from 42 to 17 and from 42 to 20 over the span of 175 d (40% and 48% remaining after 175 d). In comparison to the results reported here, the number of functional stimulating electrodes for S6 decreased from 96 to 20 over the span of 173 d (21% remaining after 173 d).

For S7, with the most recent version USEAs, a high level of functional recording electrodes was maintained throughout the 502 d study duration but the number of functional stimulating electrodes was not quantified over time. S7 did not consent to extended stimulation studies due to a self-reported narrow window between the stimulation threshold for perception and discomfort (which we speculate was related to his long-term pre-existing CRPS). An important question is whether the number of functionally connected or functionally recording electrodes can be used to predict the number of functional stimulating electrodes for S7. For example, it is a reasonable assumption that functional recording electrodes are within close enough proximity to nerve fibers that they would also be functional stimulating electrodes. The data presented here show a significant positive correlation between the number of functionally connected electrodes and the number of functional stimulating electrodes (figure 16). On the basis of the aggregate data from the four USEAs implanted in S5 and S6, we speculate that the 85, 84 and 91 functionally connected electrodes for S7-U, S7-M1 and S7-M2, would have had yielded roughly 47, 46 and 51 functional stimulating electrodes at 502 d post-implant, yielding 144 potential USEA-evoked percepts.

In contrast to findings for S7, performance of USEAs diminished over time for S5 and S6—shown most notably through a decline in the number of functionally connected electrodes, functional recording electrodes and functional stimulating electrodes.

Multiple factors may have played a role in the differences in the number of functionally connected electrodes between S5/S6 and S7. One possibility is that the lack of stimulation with S7 contributed to improved performance. However, it has also been shown that the amount of charge injected does not correlate with USEA electrode degradation [19]. Instead, more likely is that the technical improvements to the USEAs implanted in S7 played a critical role in the improved performance. Specifically, the helical wire bundle was extended all way into the connector system, and additional silicone mechanical support was added to reduce wire breakage [19]. There was noticeable delamination of the USEA backing in S5-M on explant (i.e. the USEA backing was physically detached from the USEA electrodes), which likely occurred between 15 d and 45 d post-implant and caused the upper half of the USEA to fail. Mechanical stress has also been reported as a major reason for failure for transverse intrafascicular multichannel electrodes [33]. S7 was also unique in that the devices were implanted during the amputation procedure, instead of over a decade after the amputation, but it is uncertain how these biological differences would have interacted with USEA performance over time. One possible factor is that the subject's motor activity increased over time after amputation, because of extended disuse and initial rapid fatigue arising from long-term hand disuse, dystonia, and kinesiophobia prior to amputation associated with the participant's preexisting CRPS.

It is unlikely the technical improvements were the only contributor to the longevity of functional recording electrodes with S7 because a single USEA (out of three) in S7 provided the vast majority of functional recording electrodes. This USEA, S7-M2, was the only USEA to date to have been implanted on the posterior side of the nerve under the dissected epineurium (i.e. the opposite side of the nerve relative to where the epineurium had been dissected open). We speculate that this orientation may have increased mechanical stability by allowing the residual epineurium and AxoGuard nerve wrap to provide more direct pressure holding the USEA into the nerve. This speculation is consistent with prior work that demonstrated the surgical technique and nerve-wrap stabilization highly affected the long-term performance of USEA stimulation in cats [14].

Prior work with USEAs in the sciatic nerve of cats [14] and Utah Electrode Arrays (UEAs) in the cortex of humans [21] have demonstrated that functional recording electrodes often vary over time and that consistent functional recording electrodes do not necessarily record from the same neural population consistently. The variability in functional recording electrodes and evoked percepts presented here are consistent with these prior studies. As such, ongoing work towards robust brain-computer-interface control will be critical to avoid frequent recalibration [27, 3436].

It is also worth noting that the apparent loss of USEA electrodes was not monotonic. Both S7-M1 and S7-U had zero functional recording electrodes for up an extended period of time (up to 257 consecutive days) before recording neural units once again. Similarly, S6-U had zero functional stimulating electrodes at 138 d post-implant and four functional stimulating electrodes at 173 d post-implant. USEA performance seems to stabilize over time, although additional improvements are needed to allow the USEAs to consistently stabilize with a high level of functional electrodes, like was observed with S7-M2.

We defined functional recording electrodes as electrodes that recorded neural activity with threshold crossings five times the standard deviation of the noise. This threshold-crossing value has been previously used for USEAs and eliminates false-positive detection [7, 8]. However, it is possible that the USEAs in this study could have maintained a much higher level of functional recording electrodes with a lower threshold-crossing value, as previously shown for UEAs implanted in motor cortex [37]. Similarly, we defined functional stimulating electrodes as electrodes that reliably evoked a detectable percept below 100 µA—a very conservative upper limit by safety standards. For example, the upper limit for safe stimulation based on the Shannon limit is 377 µA (when K = 1.5, pulse duration = 100 µS, and geometrical surface area = 4.5 x 10–5 cm2) [38]. Furthermore, despite being unable to evoke percepts on an individual electrode with less than 100 µA for S6-M at 342 d post-implant, useful sensory percepts were still evoked after 342 d using greater injected charge (e.g. using longer pulse widths, higher pulse currents or simultaneous multi-electrode stimulation [6]). Hence, from a practical perspective, USEAs retained the functional ability to evoke sensory percepts, even when no individual electrode retained the ability to do so below 100 µA.

5. Conclusion

USEAs provide unmatched specificity as a bidirectional peripheral nerve interface. USEAs in peripheral nerve now show long-term functionality, which is key for clinical implementation. It is likely that recent improvements in USEA design have increased the long-term performance, but additional work is required to enable consistent longevity across all devices.

Acknowledgments

We thank the amputee participants involved in this study for their willingness to contribute their lives to improve science and the lives of future amputees. We acknowledge Dr. David Kluger, Dr. Suzanne Wendelken, Dr. Mark Brinton and Michael Paskett for assisting with participant scheduling and occasional data collection.

This work was sponsored by the Hand Proprioception and Touch Interfaces (HAPTIX) program administered by the Biological Technologies Office (BTO) of the Defense Advanced Research Projects Agency (DARPA) through the Space and Naval Warfare Systems Center, Contract No. N66001-15-C-4017. Additional sponsorship was provided by the National Science Foundation (NSF) through Grant No. NSF ECCS-1533649, the NSF Graduate Research Fellowship Program Award No. 1747505, and the University of Utah Department of Veterans Affairs. The content herein represents the views of the authors, not their employers' or funding sponsors'.

Author contributions

J.A.G. collected data for S6 and S7, analyzed data, and wrote the manuscript. D.M.P. collected data for S5. T.S.D. assisted with data collection for S5 and S6, and assisted with data analysis. C.C.D. provided clinical support. D.T.H. performed surgeries and provided clinical support. L.W.R. designed and developed USEAs. G.A.C. oversaw all methods and analyses and participated in experimental sessions. All authors contributed to the revision of the manuscript.

Please wait… references are loading.