What Is AlterEgo? The Wearable Silent Speech Output-Input Device Explained

Julian Wallis
13 min read

What if you could control everything with just your mind? What if all the information on the internet was just mere thoughts away? For instance, imagine booking a ticket to the latest blockbuster without having to pick up your phone or call the theatre. It sounds like something out of a dystopian universe in a sci-fi flick, doesn’t it?

What if we told you that this could be a distinct possibility in the near future? Meet AlterEgo, a wearable silent speech output-input device that has been making waves in the tech community. But, what exactly is it? And, what can you do with it? This article delves deep into the world of AlterEgo, exploring its features, applications, and the impact it could have on our daily lives.

Understanding AlterEgo’s Origin

AlterEgo was born out of the MIT Media Lab, a renowned hub for cutting-edge technological advancements. Developed by a team of brilliant minds, AlterEgo aimed to bridge the gap between humans and machines, revolutionising the way we communicate with technology.

It was created as a communication device that allows users to interact with computers and other devices using their thoughts without the need for spoken or typed words. The project was led by Arnav Kapur and his team at the MIT Media Lab.

So, What Is AlterEgo?

AlterEgo is an innovative wearable technology designed to facilitate effortless and noiseless communication between individuals and their computing devices or peers. Its primary aim is to enhance human intelligence and seamlessly integrate computing, the Internet, and artificial intelligence into the user’s natural cognitive processes. This is achieved by establishing a discreet and silent channel of interaction between humans and machines. 

This intuitive wearable device interprets electrical signals on the skin’s surface around the lower face and neck, generated when users internally verbalise words or phrases, all without the need for actual speech, audible voices, or noticeable movements. This system offers a confidential, personalised, and unobtrusive alternative to contemporary computing interfaces.

But, Why Would Anyone Use AlterEgo?

In our current day and age, we often find ourselves interacting with computers, but this can come at the expense of our in-person communication and personal privacy. AlterEgo offers users a seamless and efficient means of connecting with their computing devices without disconnecting from their surroundings or disrupting real-world interactions. AlterEgo empowers users by placing the capability to interact with a computer subtly and effortlessly within themselves, rather than at their fingertips. 

With this device, users can discreetly and effortlessly perform tasks like recording thoughts, sending private messages, searching for information, performing calculations, or engaging with AI assistants. By doing so, AlterEgo streamlines human-machine communication, eliminating both the social and physical barriers that typically come with it, and thereby facilitating the enhancement of human intelligence.

Breaking Down The AlterEgo Components

The AlterEgo system is comprised of the following key components:

  1. A novel peripheral myoneural interface for receiving silent speech input. This interface captures intrinsic electrical signals from the surface of the user’s face and neck, subsequently analysing them to identify the words being silently spoken.
  1. Both hardware and software components are employed to process electrophysiological signals. This includes a modular neural network-based pipeline, which has been trained to detect and recognise the word or words silently articulated by the user.
  1. An intelligent system responsible for interpreting user commands and queries, generating appropriate responses in return.
  1. A bone conduction output mechanism that conveys audio information back to the user. This output serves purposes such as providing answers to questions or confirming executed commands.

A Glimpse into the Technology

At its core, AlterEgo is a wearable device that can interpret the subtle neuromuscular signals generated when we think of speaking. It’s as if it can read our minds, turning our internal monologue into actionable commands for devices. But, how does it exactly do this? More importantly, which technologies does it tap into to get this done?

The AlterEgo device relies on a combination of technologies to enable communication and control through subtle muscle movements and neural signals. Here’s a simplified explanation of the technology behind AlterEgo:

Electroencephalography (EEG) 

AlterEgo uses EEG to detect electrical activity in the user’s brain. EEG involves placing electrodes on the scalp to measure the electrical signals generated by brain activity. 

While it can’t read thoughts directly, it can detect patterns of brain activity associated with specific actions, intentions, or vocalisations.

Electromyography (EMG)

EMG sensors are used to monitor the electrical activity of facial muscles. When we think about speaking, even if we don’t actually vocalise the words, our brain sends signals to the facial muscles involved in speech. EMG sensors can pick up these signals and interpret them.

Bone-Conduction Microphones 

AlterEgo uses bone-conduction technology to transmit sound to the user’s inner ear. This technology works by vibrating the bones in the user’s face, bypassing the need for traditional headphones or earbuds. This allows the user to receive audio feedback without the need for audible speech.

Machine Learning

The key to AlterEgo’s functionality is advanced machine learning algorithms. These algorithms analyse the EEG and EMG signals in real time and attempt to recognise patterns associated with specific words, commands, or intentions. Over time, the system learns to interpret these patterns more accurately.

How AlterEgo Works

AlterEgo relies on the detection of neuromuscular signals within the articulatory muscles associated with a user’s intentional internal speech. These signals are harnessed by the system to recreate the spoken words. 

This innovative technology is employed to establish a unique user interface, allowing individuals to engage in silent, natural language communication while receiving auditory feedback via bone-conduction headphones. This approach enables a subtle and two-way interaction with computing devices, offering a smooth means of enhancing human intelligence.

Image Courtesy: MIT Media Lab

To illustrate this further, here’s a simplified step-by-step process of how AlterEgo works:

  • The user thinks about speaking or interacting with a device silently.
  • EEG sensors detect the brain’s electrical signals associated with these thoughts.
  • EMG sensors monitor the subtle facial muscle movements associated with forming words.
  • The machine learning algorithms analyse the combined EEG and EMG data to recognise the intended words or commands.
  • The device translates the user’s thoughts into text or commands and provides feedback through bone-conduction audio or other output methods.

The Brain-Machine Interface

AlterEgo utilises a non-invasive, electromyography-based approach. It comprises a set of electrodes that pick up neuromuscular signals when we subvocalise or silently articulate words in our minds. Advanced algorithms then process these signals to derive meaning.

The Silent Speech Output

Next, up, we can’t talk about AlterEgo without mentioning silent speech. But, what exactly is it? Does it mean the wearer has to move their mouth to use this device? Silent speech stands apart from both the act of thinking about words and the act of vocalising them audibly. Think back to when you were first learning to read. Initially, you would vocalise the words you read aloud, but with time, you acquired the skill of mentally articulating these words silently. 

To progress to quicker reading speeds, you needed to shed the habit of “silent speaking” the words you encountered. Silent speaking is a conscious endeavour to utter a word, marked by subtle movements of the internal speech organs without producing audible sounds. This process generates signals from your brain to your muscles, which our device detects as neuromuscular signals and subsequently processes.

The device deciphers these signals and translates them into text or voice commands. This means you can simply think of a message, and AlterEgo can send it as a text or vocalise it for you. It’s a true marvel of technology.

Applications Beyond Imagination

AlterEgo introduces a wide array of possibilities. It empowers a user to seamlessly connect to the Internet, accessing the vast knowledge of the web essentially as an extension of themselves. For instance, a user could internally vocalise a Google query and receive a response through bone conduction without any outward actions. The device’s primary goal is to enhance human communication by harnessing silent speech as a means of transmitting information between individuals.

So, what can be done with AlterEgo after this technology is refined and distributed commercially? Let’s take a look at some of its possible applications in the real world.

Telecommunications

In the realm of telecommunications, this system has significant implications. It enables people to communicate with the convenience and bandwidth of vocal speech while preserving the fidelity and privacy offered by silent speech. Additionally, the system functions as a digital memory bank, allowing users to internally record streams of information and retrieve them later through the system. This feature is particularly valuable for individuals with memory difficulties who can quietly request the system to remind them of an acquaintance’s name or the answer to a question, avoiding the potential embarrassment of openly seeking this information.

Level Up Internet-Of-Things

Moreover, the system empowers a human user to control internet-of-things (IoT) devices and operate various appliances without any noticeable actions. For instance, when paired with a Bluetooth speaker, AlterEgo can even translate internally vocalised phrases into other languages, facilitating multi-lingual conversations.

Stay Informed All The Time

Looking forward, one can envision scenarios in which professionals, such as doctors, silently consult clinical decision-making AI agents through AlterEgo to enhance the delivery of medical care. What’s crucial here is that users need not disconnect from their surroundings to access computer services. This system enhances a user’s engagement with the present moment or ongoing conversations. 

For instance, in a meeting, if someone uses a word you’re unfamiliar with, you can silently request the system to provide a definition, ensuring you remain engaged in the discussion. Similarly, if you’ve met someone before but forgotten their name, the system can quietly consult your address book to assist you.

Empowering People with Disabilities

One of the most significant impacts of AlterEgo is its potential to empower individuals with speech and mobility impairments. It offers them a means to communicate with the world effortlessly, fostering inclusivity and independence.

Boosting Productivity

In a world where time is of the essence, AlterEgo can be a game-changer. Imagine typing out emails and texts or even controlling your smart home devices with mere thoughts. The possibilities for increased productivity are endless.

Enhanced Gaming Experience

For gamers, AlterEgo opens up a new dimension of interaction. It can interpret your in-game commands seamlessly, immersing you further into the virtual world.

AlterEgo being used to play chess

The Future of Communication

As AlterEgo evolves, it has the potential to redefine how we interact with technology. Traditional input methods may become obsolete as this wearable device offers a more natural, intuitive way of communication.

Current Limitations & Concerns With AlterEgo

Social Concerns Of This Technology

One of the reasons why modern smartphones have been so disruptive is because they can be cumbersome to use, often demanding the user’s full attention to interact with them. AlterEgo, on the other hand, offers a way to access the vast array of online information and services in a seamless and socially less intrusive manner. 

Users no longer have to interrupt their regular activities to engage with a computer. MIT’s research team believes that AlterEgo will enable individuals to maintain a stronger connection to the real world while harnessing the power of computing whenever needed. The broader societal impact of this device is an area that still requires formal investigation, however.

The Design Could Be Better, Right?

Up to this point, the MIT research team has primarily focused on ensuring the functionality of the technology. They haven’t given top priority to the physical design or the form factor of the device. However, their team is convinced that advancements in electrode design, electrophysiology modelling, materials, and industrial design will make this gadget more unnoticeable. The device’s design is closely tied to human neurophysiology, and the MIT research team is actively exploring more minimalist device designs that can accurately recognise silent speech.

Privacy Concerns

While the benefits are undeniable, the integration of AlterEgo into our daily lives also raises concerns about privacy. How secure are our thoughts and personal data? These questions will become increasingly relevant as the technology progresses.

But as of now, MIT has been adamant that the device doesn’t read your thoughts. AlterEgo does not possess the capability to delve into your thoughts. What sets this system apart is its ability to interpret signals originating from your facial and vocal cord muscles when you consciously articulate words silently. 

The system lacks direct physical access to brain activity, rendering it incapable of deciphering a user’s inner thoughts. It remains paramount that users maintain complete control over input under all circumstances, ensuring that such an interface does not gain access to their thoughts, as the device exclusively processes words deliberately voiced in silence as inputs.

What About The Performance Of The Device?

At present, MIT has a functional prototype that achieves over 90% accuracy with user-specific vocabulary after training with individualised data. The system is currently dependent on user-specific training and customisation. The ongoing efforts of their research team are directed towards creating iterations that eliminate the need for personalisation.

When Can People Buy & Start Using AlterEgo?

It’s important to note that this project is research-based within a university setting. MIT’s ongoing work on AlterEgo focuses on enhancements such as reducing the number of electrodes required, creating more socially acceptable device forms, improving the neural networks responsible for recognising silent speech, and minimising the training and customisation prerequisites. And, thus, It’s worth emphasising that any aspirations for commercialisation at this stage are premature. 

AlterEgo: The Road Ahead

The development of AlterEgo is a continuous journey, and improvement and refinement processes are still ongoing. Researchers and engineers are constantly working to refine its accuracy and expand its applications. We can expect to see even more impressive features in the near future.

In Conclusion – What Does The Future For AlterEgo?

AlterEgo, the wearable silent speech output-input device, is a testament to human ingenuity. It has the power to transform the lives of individuals with disabilities, boost productivity, and redefine human-machine interaction. 

While it raises valid privacy concerns, the future of AlterEgo is undeniably promising. As we move forward, we eagerly await the next chapter in the story of this remarkable technology. As technology continues to advance, we can only imagine the incredible innovations that lie ahead. 

AlterEgo is just one example of how our relationship with technology is evolving, and it’s a testament to the endless possibilities that the future holds. So, stay tuned, stay curious, and embrace the wonders of AlterEgo and the technological marvels yet to come.

Now that you understand what AlterEgo can do, it’s time to explore how technology such as it can revolutionise the way businesses interact with their customers. Our expert consultants are ready to show you the way. Book a discovery call today and let us help you harness the power of technology for unparalleled customer engagement. Your journey to amazing digital experiences starts here!

Topics
Published On

September 29, 2023