Breaking Barriers: How APP2Speak and Apple’s Eye Tracking Technology Empower Nonverbal Adults with Degenerative Diseases
The Heartbreaking Challenge of Speech Loss
Imagine waking up one day unable to express your thoughts, needs, or emotions. For millions of people worldwide with degenerative conditions like ALS, MS, or Cerebral Palsy, this is a daily reality.
Losing the ability to speak can lead to deep frustration, social isolation, and a loss of independence. However, amazing advances in assistive technology now offer new ways to bridge the communication gap and restore a sense of control.
Augmentative and Alternative Communication (AAC) solutions like the APP2Speak app, combined with Apple’s latest iOS accessibility features, are transforming the way nonverbal individuals communicate.
With the introduction of Apple’s eye-tracking functionality, people with limited mobility now have a powerful hands-free communication tool at their disposal. This truly is life-changing technology, and all you need to use it is an iPhone or iPad!
Understanding AAC and Apps for Nonverbal Communication
Augmentative and Alternative Communication (AAC) apps are designed to help individuals who struggle to communicate express themselves through digital means. APP2Speak is one such speech assistance app that provides:
- Text-to-speech functionality – Converts typed text into spoken words.
- Customizable communication boards – Allows users to customize phrases connected to personally selected photos for easy communication.
- Pre-set and user-defined messages – Enables quick and efficient responses.
APP2Speak is designed for individuals with speech challenges, offering an intuitive interface that makes communication accessible and efficient.
Apple’s iOS Eye Tracking Technology: A Game Changer in Accessibility
Apple’s commitment to accessibility has reached a new level with its latest iOS updates, released in 2024.
One of the most groundbreaking features offered in the latest update is Eye Tracking, which allows users to navigate their iPhone or iPad with just their eyes. This is a transformative tool for individuals with limited mobility who struggle to use touchscreens or external switches.
How Eye Tracking Works
- Apple’s Eye Tracking feature uses the front-facing camera on your phone or iPad to detect and track eye movement.
- It enables you to navigate menus, open apps, and type text—all without physical interaction.
- It works seamlessly with AAC apps like APP2Speak for hands-free communication.
While APP2Speak gives the gift of communication to people who cannot speak due to many conditions—a stroke, laryngectomy, brain injury, etc.—for individuals with degenerative conditions, Apple’s Eye Tracking feature ensures continued access to communication tools, even as their mobility declines.
Setting Up APP2Speak with iOS Eye Tracking
Getting started with the powerful APP2Speak-iOS Eye Tracking combination is as simple as 1-2-3:
Step 1: Enable Eye Tracking on iOS
- Go to Settings on your iPhone or iPad.
- Navigate to Accessibility > Eye Tracking.
- Follow the on-screen instructions to calibrate eye movement.
- Customize settings for sensitivity and speed as needed.
2: Install and Set Up APP2Speak
- Download APP2Speak from the Apple App Store.
- Open the app and navigate through the ? help tutorial.
- Customize your communication pages by adding personal images.
- Save frequently used phrases on the text-to-speech feature.
Step 3: Integrate APP2Speak with Eye Tracking
- Launch APP2Speak using eye-tracking navigation.
- Select communication photos and phrases by focusing on them.
- Use text-to-speech to convert typed messages into spoken words.
- Experiment with different settings to optimize ease of use.
The steps listed above are a short-hand checklist of what to do to start using this powerful combination of technologies.
If you’d like a demo of how APP2Speak works either prior to downloading it or afterwards, just reach out to us on the Contact page. I’d be happy to walk you through everything you need to know, including how to integrate APP2Speak with Eye Tracking.
Real-Life Impact: How Technology Can Transform Lives
It’s hard to overstate the impact this technology can have on the life of someone with a degenerative disease.
In my time working with patients with speech challenges, I’ve worked with many people whose conditions were slowly worsening due to their disease. I created APP2Speak so that those individuals who had lost or were losing their ability to speak could continue to communicate with those around them and live full lives.
However, before eye tracking technology became more available, when a person’s ability to manually operate the app declined due to a degenerative disease, they were out of luck. That’s no longer the case.
Case Study: Ken
One of my patients, Ken, lived in Florida. He was in his 70s when I first met him. Ken had Parkinson’s Disease, and his speech was severely limited.
When he and his wife were looking for something for him to use so he could continue to communicate with those around him, a speech pathologist with the VA recommended a “big box” AAC device. This device costs around $12,000, but the VA would pay for it, so they ordered the device.
The problem was, the device was too bulky and heavy for Ken to use it easily, as he was quite frail by this time. In addition, his wife said that they received almost no training on how Ken could use the device, and it was too complicated for them to even figure out how to set it up—so basically, Ken never used it.
That’s when they started searching for something else on Google and came across APP2Speak. Since APP2Speak is so much easier to set up, learn, and use than the big box device, Ken was quickly able to start using it.
Then, when the iOS accessibility features came out, his wife set up Eye Tracking for him and he was able to use the combination of APP2Speak and Eye Tracking to communicate.
Unfortunately, Ken’s condition worsened quickly after this, and he passed away. I only wish he had found APP2Speak earlier and been able to use it with Eye Tracking for longer!
Addressing Common Concerns
I know that purchasing and learning new technology can be scary, which prevents many people from taking advantage of these life-changing tools. Here are some of the most common questions and concerns and my response to them:
Issue #1: Learning Curve
Concern: “Is it difficult to learn how to use these tools?”
Solution: Apple’s Eye Tracking and APP2Speak are designed with user-friendly interfaces. Most users can adapt quickly and start using them with minimal training.
Issue #2: Device Compatibility
Concern: “Which devices support Eye Tracking?”
Solution: This feature is available on newer iPhones and iPads with iOS 17 and later. Check Apple’s official website for an updated list of compatible devices.
Issue #3: Troubleshooting Issues
Concern: “What if the eye-tracking feature isn’t working well?”
Solution: Ensure proper lighting, camera calibration, and clear eyesight visibility for optimal performance. Adjust your settings under Accessibility > Eye Tracking if necessary.
Embracing Technology for a More Connected Future
Losing the ability to speak doesn’t have to mean losing the ability to connect. With cutting-edge technology like APP2Speak and Apple’s Eye Tracking feature for iPad and iPhone, individuals with speech impairments can reclaim their voice and maintain meaningful relationships—even if they can’t physically manipulate their devices.
If you or a loved one could benefit from these tools, now is the time to explore their potential. Download APP2Speak and try Apple’s accessibility features today—because everyone deserves to be heard!
And if you found this post helpful, please share it with caregivers, family members, and healthcare professionals to spread awareness of these life-changing tools.