Showing posts with label voice ouput. Show all posts
Showing posts with label voice ouput. Show all posts

Eye Gaze Technology: Language access software

Language access software—now that is a very exciting topic! Seriously, it truly is…and I hope you get as excited about it as I do.

Once kids are able to access a computer through eye gaze, what is it they are going to say? How are they going to say it? THAT is what the language access software is all about, and it plays a HUGE role in successful communication.

Little nuances in fit make all the difference in comfort,
even within the same size!
Getting a good fit between child and language access can’t be stressed enough. It’s like fitting a shoe…even within the correct size, there are nuances to the fit of a shoe that make it successfully comfortable…or irritatingly painful. It’s got to fit right or it just plain isn’t a good match.

The key to selecting the appropriate software is your student—her learning and internal organizational style, what she wants to say, how complex her communication abilities are (or have the potential to be), even what level you hope her to achieve 20 years from now since what she does today can help lay the foundation.

Another consideration is how many hits it takes to create the message she wants, because even eye gaze is very fatiguing. And we know with Rett syndrome or any other disorder involving severe apraxia, motor planning of any kind is extremely exhausting.

Last week we talked about the devices made by Dynavox, Tobii, and Prentke-Romich. All three manufacturers use programs with different methods of organizing language and retrieving vocabulary. While there is a learning curve with each system, it could be that the language organization on one clearly stands out during the trial period as a better fit for your student.

In addition to the software packages traditionally associated with these devices, there are third-party packages that can be installed on most any of them. These open up even more options to the user, but I’m going to stick to the programs typically used by each of the manufacturers to simplify the discussion. The same evaluation principles apply when looking at third party software, such as WordPower or Picture WordPower or PODD.

So that leads us to language organization. I apologize in advance if I'm covering what you already know; I've learned it's best not to make assumptions (sheepish grin).

Language is stored as letters, words, or phrases.

1) When it is stored as letters, we have an onscreen keyboard, typically with each letter taking a single hit to spell out a word. The number of hits to create a message depends on word and message length.

The benefit of spelling is that it allows an infinite number of novel messages. There are also word prediction and abbreviation expansion options that can cut down keystrokes.

But even with these options, the high number of hits to spell is fatiguing. Spelling also tends to be frustratingly s-l-o-w with eye gaze, so that back-and-forth conversation requires excruciating patience.

2) When language is stored as words, it allows for as much novel message creation as most of us are likely to use in a lifetime, although unique words will have to be added.

Words can be accessed through one-key hits or through key combinations.
Creating complete sentences is still slow, but doable. Most AAC users who opt for words have very "telegraphic speech."  That is, they might say "cookie" "please" instead of "Will you please get me a cookie?" After all, the motor demands make words expensive in energy output. Kids can still be very effective in communicating a message that way, though.

Usually a person needs more vocabulary than can be stored on a single page. So pages are created to categorize the words. This is the most familiar language organization strategy.

For example, to reach the word "zebra," you might need to navigate from Nouns (or Things) > Animals  >  Zoo  >  more Zoo words > zebra, taking 5 hits to access the word “zebra.” Sometimes going through the organizational tree can take more hits than just typing out the spelling, unfortunately.

A challenge with this system is that memorizing the placement of the buttons can be very difficult. Each page offers a new array of buttons that must be visually scanned, which can be a tricky task for eye gazers, since eye movements are being tracked by the computer. The programmer must work hard to maintain consistent placement of buttons to support motor automaticity.

Let’s talk for a minute about motor automaticity and why it is essential for eye gaze users.

Motor automaticity is when your body moves the way you want without you having to think about it. It is the skill that lets you reach the stick shift or turn signal lever in your car without having to look. Touch typists use this skill as they fly over the keyboard, hitting all the right letters without peeking.

Your body knows where the shifter or turn lever or computer keys will be through repeated practice. Touching these things becomes automatic; you don’t have to look or even think about it. They are always located where your body expects them to be.

People who use eye gaze can—and should—develop motor automaticity with their eye movements. Their eyes come to expect certain keys to appear in the same position each time.

By contrast, scanning with the eyes can cause unintentional mis-hits when a child’s eyes dwell a little too long during the scanning process. The sooner a child can learn motor automaticity, the more accurate his communication becomes.

Single words can also be retrieved through a process called “semantic compaction,” which aids motor automaticity. Each stationary key represents a concept, and the concepts are combined to create a single word. For example, if you hit "apple," which represents food, and "verb," you get the word "eat." Similarly, "apple" + "feelings" = "hungry." A large vocabulary can be accessed in 2-3 hits. The keys are static and their layout can be committed to motor memory.

Semantic compaction tends to require more learning for the adults supporting a child than for the child herself. I'll share my bias--I was highly skeptical at first but forced myself to learn the system and found it to be VERY slick! I'm a believer now. Several summers ago, I had the opportunity to meet an amazing woman with severe CP who can speak at normal conversational rates using a head mouse with this system. Impressive, let me tell you.

3) A third system of vocabulary organization is phrase-based. In this, a person navigates to categories for various situations and hits a key to activate a pre-programmed phrase. This can make for fast conversation, but the person is limited to saying only what is programmed on the device. 

Imagine going up to a friend. In one hit, you can ask "How are things going at work?" That's quick access! And sometimes, it meets your needs well. 

But imagine this friend has just lost his job... Suddenly, "How are things going at work?" is completely inappropriate. The likelihood that "Sorry to hear about your job situation" is programmed onto the device is pretty slim.

To address this problem, some programs include partial phrases, like sentence starters, or “slot fillers” (fill in the blank). Some are more elegant in their capabilities to do this than others.

The software programs on each of the devices combine options of choosing from letters, words, and phrases, which is a GOOD thing. No one wants to be stuck with just the phrases someone else decides are important! All three include some keyboard for spelling, so I won't mention that again.



Dynavox’s Vmax runs Windows 7 and uses InterAACt.
This is a dynamic (meaning "changing" in this context, as opposed to static or stationary) page-based system for organizing single words and phrases. With it, you start with a page of broad categories and narrow down to smaller categories until you find the page with your word/phrase.

A plus to this is that it makes sense to the staff that programs the device. As an aside, the version of InterAACt I used six month ago desperately needed its programming design updated...taking many steps that should have been automated by now. It is possible that the newest version, 1.07, may have some improvements since that time.

Another plus to InterACCt is that it can hold a nearly infinite number of topic pages, which is nice for school.

The downside for the user is that chances for motor automaticity are very small--every page looks different. And every time a new vocabulary word is added, the page changes.

I find that it really doesn't lend itself to composing sentences--too many hits. For single words, it can be okay though. And for phrase-based conversation that will not change often, it works well.


PRC devices run Windows XP and use Unity
, which is based on semantic compaction. The core vocabulary is offered in several sizes, with each supporting motor automaticity and few hits to access a huge vocabulary.

It also incorporates a dynamic activity row which changes automatically with the categories as they are selected, including phrase-based conversations. From the "apple" key from the earlier example is hit, the activity row will show food-specific words that would be cumbersome to memorize with key combinations.

It also has sets of pages of one-hit topic vocabulary that can be built for school subjects.

I find Unity easy and quick to program, although you have to fully understand the language structure to locate new vocabulary wisely…or you can foul up the logic if you program into the Core set poorly.

On the downside, the software is less elegant for creating things like quizzes for class. The key sizes are pre-defined and sometimes you would like to have creative license on that.

The other drawback is that staffs tend to perceive Unity as being overwhelming to learn, which is unnecessary, but sadly often the case. PRC in our area offers excellent training that can help overcome that fear. The kids tend to look at it like a super-cool secret code, so I have yet to meet a child resistant to learning it.


Tobii C-12 uses Windows Vista and uses Communicator 4
as a base set. It functions much like InterAACt but with state-of-the-art programming.

Equally important, they have an add-on package (included as part of the device purchase) called Sono Lexis that combines some of the best of the other two navigation systems.

It has rows of one-hit high-frequency core words (such as I, you, want, like, not) that are always accessible. There are stationary category keys that open additional rows of vocabulary above these core rows. It also has a category for phrases.

It provides more motor automaticity than Dynavox's InterAACt but less than Unity on the PRC devices. It's pretty well thought-out, fairly customizable (and I have requests in to the company for features that would make is moreso), and easily programmed.

You can step outside of Sono Lexis to make pages that look however you want, which is nice for classroom activities.

To be honest, I wasn't in love with Sono Lexis at first but the more I play with it, the more smitten I become.

The major complaints I have are that I'd like to be able to customize the core vocabulary and to solve the problem of arranging new vocabulary added to the category rows so that it is logically organized (alphabetizing isn't always the most logical, and inserting a new word in ABC order throws off the motor memory). I’d also love to see a “replace all” feature, but then I want it all!

The new Tobii C-15 will run Windows 7 and the Communicator 4/Sono products.


 
There you have the basic run-down on the Major Three software programs for language access. Each has strengths and areas that could be improved. They all can be simplified for children who need to start at a basic level. But it is important for you to look at the capabilities of each to get a feel for what each can offer at higher levels.

Any comments you might make on these systems to help others?

* * * * * * * * 

Here are some additional posts you might find helpful:

Eye Gaze Technology:  Looking at the hardware

Eye Gaze Technology:  Time for a trial! 


Eye Gaze Technology for AAC: Looking at the Hardware

We live in such an exciting time! Leaps in technology have opened doors for computer access in ways that we didn’t even know to dream about just a few years ago.
(Creepy picture...I couldn't find a copyright-free image
of a child using eye gaze on a device, sorry!)
Eye gaze technology can be a miracle for people with severe motor impairments who cannot touch a screen or control a mouse or joystick. When coupled with a voice output device, it may give “voice” to someone who is otherwise unable to speak.
Regularly, the question comes up in circles where I hang out about how to pair up a child with one of the eye gaze systems to access an AAC device. It’s such a big question; let’s look at it over the next few Thursdays in smaller parts.
Disclaimer:  I speak from personal experience and my own research. All children, even those sharing the same diagnosis, are unique individuals with specific strengths and needs that must be considered in evaluating the different systems available.
Please keep in mind that technology changes daily. Current specs that apply to today’s devices (3/10/2011) will be replaced by specs for new devices tomorrow.
Also, I am not affiliated with any manufacturer and receive no compensation for expressing my views.
Today let’s look at the eye gaze hardware used to access computerized voice output devices.
Eye gaze not the same as head tracking, where a camera watches a point on the head or other body part as the person moves. Instead, this technology watches eye movement independent of what the head does. This allows access for people who have no other movement, as well as people with uncontrolled movements in the rest of their bodies.
Experience by any number of clinicians working with girls with Rett syndrome have shown eye gaze to be an effective means of input for many of their clients. The same findings are true for children with other diagnoses who have severely limited motor output.
I personally recommend having the option of eye gaze on AAC devices for girls with Rett whenever possible, even if a child is currently capable of using touch to access a device. There is no way of knowing what skills will stay strong in Rett syndrome and which will decline. Unfortunately, touch skills tend to be one of the skills that are difficult to maintain in the long term. As well, when kids are sick, any access method is demanding and eye gaze is often easier than touch access  during that period. Since an AAC device is a 5-year commitment before insurance funding can be accessed again, if it is at all possible to include the eye gaze function (an additional option of about $7,000, unfortunately, and thereby requiring lots of justification for funding), I do suggest that. At this time, the eye gaze units can be disconnected so they don't need to travel with the device when not needed.

As far as which devices to evaluate, try to arrange trials with several manufacturers. Sometimes one will "click" with a student over the others in a very obvious way right from the initial exposure.
My experience is limited to three major manufacturers distributing in our area:  Dynavox, Tobii, and Prentke-Romich. Other companies also manufacture eye gaze devices, but I have no experience with these. If anyone can add their experience in the comments section with these other companies, we can all learn from you.
The eye gaze hardware and software is different between the three main devices (Dynavox’s Eyemax, Tobii's C-12 with CEye, and PRC's ECOpoint). Each one includes a touch screen and a removable eye gaze unit. Weights for the computers and their eye gaze units differ somewhat, with the Dynavox Eyemax being the heaviest at 9 lbs. 2 oz. The PRC ECOpoint combination is 7 lbs. 4 oz. Tobii lists only the base weight of the C12 as 6 lbs. 8 oz., with the CEye unit not specified (though I would guess it to be somewhere in the 7-8 oz range). Weight may not be an issue for a device that will be mounted on a wheelchair or carried by an assistant.

Prentke-Romich has one of the best descriptions of eye gaze range and tolerance for movement that I have read. They describe an imaginary "box" surrounding your head. So long as your head stays inside that "box," the unit can read your eyes. Move outside that "box" and your gaze will be lost. It is also possible that the calibration to the unit may be lost, depending on the device, and require that the child complete the calibration exercise again.
Each manufacturer's device has a uniquely sized and shaped box. One "box" may be preferable for your student than another (i.e.: if she rocks back and forth, then depth may be a more critical dimension than side-to-side or height). I'll share these with you as height (up and down motions) x width (side to side) x depth (back and forth).

On to the three eye gaze devices I have used with children, and my own daughter in particular:

a) Dynavox's Eyemax was an early arrival on the eye gaze market. It is the eye gaze accessory that combines with the VMax or Vmax+. I found it to be fairly particular about positioning. It's "box" is
6" high x  9.4" wide  x 11” deep for a person sitting 17-24" from the device.
While it stayed calibrated well for my daughter, the small "box" did not accommodate the large movements she makes. I would expect someone with much smaller head movements to have greater success.

b) Tobii has 2 different eye gaze units, each accompanying a specific device. The MyTobii P-10 has a built-in eye gaze function and, while portable, is mainly intended for stationary use in bed or at a desk. It is purported to have extremely exact eye reading capabilities (I haven't personally tried it, so I can't comment). It's tolerance for movement is
12” high x 16” wide x 8” deep at a distance of 20 to 28 inches The CEye is the eye gaze unit for their portable C-12 device and is very forgiving of movement. It allows movements 12” high x 16” wide x 8” deep at a distance of 18 to 26 inches. In our experience, it was the most accommodating of large head movements and of leaving/returning without requiring recalibration. Tobii’s new C-15 voice output device is due to be released to the public market any day; it appears to use the same CEye unit for eye gaze as the C-12 (I could be wrong; please check with your local rep if you are interested).
c) PRC's ECOpoint is an eye gaze unit manufactured by Tobii to be used with PRC's ECO2 or Essense PRO. Its "eyebox" measures 10" x 15" x 8" at a distance of 20-24". We personally had less success with it’s eye gaze than with the Tobii CEye unit. For us, it didn't accomodate large head movements as well and seemed to require recalibrating more often. However, some kids do better with the PRC eye gaze, which underscores the importance of trying many devices. One SLP I talked with said in her experience, mobile girls and those with large movements tend to have better success using the Tobii and girls in wheelchairs tend to have better success on the ECOpoint. 
At www.AACTechConnect.com, you can print off a comparison chart of the three devices with a greater number of specs, including computer and operating system specifications, touch screen size, battery performance, along with the types of drives and ports each has. These take on a bit more importance if the device will also be used in a computer capacity instead of just for communication.

I hope that gives you a start on thinking about hardware issues. The first step to using any AAC device is being able to access it. After all, the most wonderful language systems are only as useful as a child’s ability to access them. Your team’s occupational therapist can be GOLD in helping to determine the best unit for access for your child.
Next week, on to language access software!
What questions do you have about evaluating eye gaze technology with AAC? Please leave a comment below…I greatly appreciate comments!
* * * * * * * *
You might find these other posts useful: