Mind-Controlled Webcam with 0.5-Degree Precision Enhances Neuralink Patient's World Interaction

Image for Mind-Controlled Webcam with 0.5-Degree Precision Enhances Neuralink Patient's World Interaction

Brad Smith, an ALS patient and one of the first recipients of Neuralink's brain-computer interface (BCI) implant, has significantly enhanced his ability to interact with his surroundings by integrating a customized Insta360 Link 2 webcam controlled entirely by thought. This innovative setup allows Smith to overcome the limitations of previous eye-tracking systems, which were often slow, tiring, and restricted to indoor use, providing him with a "second pair of eyes" for a more dynamic engagement with his family and environment.

Smith, who received his Neuralink implant in November 2024, now moves a laptop cursor by thought, translating neural activity associated with hand movement into digital commands. This BCI capability forms the foundation for his advanced control system, replacing the less efficient eye-tracking software he previously relied upon. The integration represents a crucial step in enabling users with severe motor limitations to gain greater independence and communication fluidity.

Driven by a desire to watch his child play soccer and observe people around a room, Smith sought a "digital periscope." He independently researched and selected the Insta360 Link 2 webcam for its maneuverability. Initially, Neuralink engineers were "really confused with the idea," Smith told The Verge, but his persistence led to a collaborative effort to realize his vision.

Neuralink subsequently provided assistance in mounting the camera on Smith's wheelchair and fine-tuning the system, ensuring the setup could be reused by future BCI patients. Concurrently, Insta360 customized the webcam's control panel, allowing each thought-controlled click to move the camera faster and farther, alongside a second panel designed for precise 0.5-degree nudges, crucial for detailed observation.

This bespoke solution has dramatically improved Smith's quality of life, allowing him to "look around, take photos and videos, and engage with my family in ways I couldn't before, restoring a sense of mobility in my gaze," he stated in a video. Beyond the high-tech integration, Smith continues to employ practical, low-tech solutions, such as a $20 dog bell in place of a medical call button and pre-saved phrases in his text-to-speech app, to maintain seamless communication in fast-paced conversations. Smith characterizes the overall impact as "rehumanizing us, giving back agency in a world where our bodies fail."