Voice recognition testing with Dragon Naturally Speaking
Voice recognition allows for the dictation of the spoken word or the ability to recognize and carry out commands in an application. Voice recognition converts analog speech into digital signals. These signals are then compared to known or learned patterns to take action by creating a written representation through dictation or carrying out a command.
Research into voice recognition began in the 1970s with the United States Department of Defense, but it was not until 1990 that Dragon Systems released discrete word dictation-level speech recognition software. It was the first time dictation speech and voice recognition technology became available to consumers. In 1997, Dragon Naturally Speaking became the first voice recognition software to detect continuous speech (without breaks between words).
Voice search for Google was introduced in early 2000, which led to the development of personal assistants, including Siri and Alexa. The popularity of smartphones paved the way for home devices such as Google Home and Amazon Echo. These technologies have been an enormous step forward for individuals with disabilities, providing them with more independence. For use with computers, Dragon Naturally Speaking remains the preferred method to navigate and interact directly with web content.
Dragon Naturally Speaking overview
Dragon Naturally Speaking is a suite of speech-recognition tools published by software developer Nuance Communications. Dragon originated as dictation software for the medical industry before helping users with mobility challenges.
Dragon provides a way for an individual to interact with an application when they cannot use a keyboard or input device other than verbal. Through spoken commands, users can fully navigate an application.
Similar to screen reader technology, the HTML code that supports a web page translates into the command that works with Dragon. So, users identify and command an element to function.
Dragon can accept voice commands that perform pointer-based input, such as "mouse double-click," and keystroke commands, such as "press Enter."
Users of Dragon and other voice-recognition systems
A wide range of individuals uses voice recognition software such as Dragon to access technology more efficiently.
In the following figures, select the hotspot (+) icons to learn about the types of users who benefit from voice recognition software.
Testing with Dragon
The key to testing with voice recognition systems, such as Dragon Naturally Speaking, is ensuring that all interactive application components work as expected.
The first thing you can do to test your application is to ensure that all your interactive items, such as fields, buttons, and components, have proper labels. Ensure that your labels are unique because they are the primary way Dragon users access screen components. After you label your components, you need to walk through your use cases or a task workflow that users typically undertake.
There are three primary ways for Dragon users to access information:
- By element
- By type of element
- By location on the page
The following list demonstrates common voice commands and their related actions:
- Tab (n) time: Moves through the interactive elements on the page for the total number indicated.
- Click link or element name: Activates the specific link or element.
- Click link: Places a visual number next to all the links on the visible page from which you can choose.
- Press Enter: Activates the element you are on.
- MouseGrid: Overlays a grid on the screen from which you can narrow down the location you want on the screen.
- Mouse click: Activates the element on which you focus.
Navigating by element
The following video demonstrates how to navigate in Dragon by using a screen using element name. The transcript following the video also provides the details on commands and resulting action.
Transcript for navigating by element
Video screen shows My followed items page with focus in search box.
Speaker says "Tab". Video shows focus move to operator icon.
Speaker says "Tab". Video shows focus move to Create button in navigation pane.
Speaker says "Click create". Video shows Create menu open.
Speaker says "Move down". Video shows focus moving down the options in menu and stops on Bug option.
Speaker says "Press enter". Video shows a dialog modal open up and focus placed in the first field called 'name.
Speaker says "New issue". Video shows the words 'New issue' being typed in the name field.
Speaker says "Tab". Video shows focus move to the next field, i.e., Description field.
Speaker says "New issue". Video shows the words 'New issue' being typed in the description field.
Speaker says "Tab". Video shows focus move to the description toolbar.
Speaker says "Click bug type". Video shows focus moving to dropdown field named 'Bug type'.
Speaker says "Press enter". Video shows dropdown open to show all options available.
Speaker says "Move down". Video shows focus move to first option shown, "accessibility".
Speaker says "Press enter". Video shows selection of "accessibility" now inside dropdown and focus remaining on this field.
Speaker says "Click cancel". Video shows focus move to the button labeled "Cancel". The button is selected and a dialog modal opens.
Speaker says "Click discard". Video shows focus moving to button labeled "Discard". The button is selected and focus moves back to main screen.
Navigating by type of element
The following video demonstrates how to navigate a screen by using element types with Dragon, such as "Show links."
Transcript for navigating by element type
Video screen shows My followed items page.
Speaker says "Show links". Video shows a series of numbers alongside every interactive element on the page, including links and buttons
Speaker says "Choose five". Video shows focus to move to the element next to the number five, which is the option 'Backlog' within the 'Create' menu.
Speaker says "Move down". Video shows focus move to the next option in list which is 'Bug'.
Speaker says "Press enter". Video shows dialog modal open and focus moves to the first field 'Name'.
Speaker says "New issue". Video shows the words 'New issue'being typed into the 'Name' field.
Speaker says "Tab". Video shows focus move to next field called 'Description'.
Speaker says "Click list box". Video shows a series of numbers alongside the listboxes (or dropdowns) on the page.
Speaker says "Choose two". Video shows the selection of 'Bug type' list option.
Speaker says "Press enter". Video shows options available in the list.
Speaker says "Move down". Video shows focus move to first option shown, "accessibility".
Speaker says "Press enter". Video shows selection of "accessibility" now inside dropdown and focus remaining on this field.
Speaker says "Click cancel". Video shows focus move to the button labeled "Cancel". The button is selected and a dialog modal opens.
Speaker says "Click discard". Video shows focus moving to button labeled "Discard". The button is selected and focus moves back to main screen.
Navigating by location on page or Mouse Grid
The following video demonstrates how to navigate a screen by using the Mouse Grid feature with Dragon:
Transcript for navigating using Mouse Grid
Speaker says "Mouse grid". Video shows a nine square grid covering the entire visible screen where there is a number in each square, labeled one through nine.
Speaker says "One". Video shows the nine square grid but now only within the space that was previously occupied by square number one from first grid.
Speaker says "One". Video shows the nine square grid but only within space of the square selected in the previous grid, essentially narrowing down the screen to a small section.
Speaker says "Eight". Video shows same nine square grid but only within space of the square in the previous grid, which is now a much smaller space on the screen
Speaker says "Click". Video shows a mouse click on the 'Create' menu button and then focus on the 'Backlog' option from within the open 'Create' menu.
Speaker says "Mouse grid". Video shows a new nine square grid covering entire screen
Speaker says "One". Video shows the nine square grid but only within space of the square selected in the previous grid
Speaker says "Four". Video shows the nine square grid but only within space of the square selected in the previous grid so that focus is on 'Bug' option in 'Create' menu is
Speaker says "Click". Video shows selection of 'Bug' option within 'Create' menu and a dialog/modal opens with focus on first field
Speaker says "New issue". Video shows the words 'New issue' being typed in the name field.
Speaker says "Tab". Video shows focus move to the next field, i.e., Description field.
Speaker says "New issue". Video shows the words 'New issue' being typed in the description field.
Speaker says "Mouse grid". Video shows a new nine square grid covering entire screen
Speaker says "Seven". Video shows the nine square grid but only within space of the square selected in the previous grid
Speaker says "Six". Video shows the nine square grid but only within space of the square selected in the previous grid
Speaker says "Two". Video shows the nine square grid but only within space of the square selected in the previous grid so that focus is on 'bug type' dropdown
Speaker says "Click". Video shows selection of 'bug type' dropdown and expanded with list of options
Speaker says "Move down". Video shows focus move down to the first option
Speaker says "Press enter". Video shows selection of 'accessibility' option
Speaker says "Mouse grid". Video shows a new nine square grid covering entire screen
Speaker says "Seven". Video shows the nine square grid but only within space of the square selected in the previous grid
Speaker says "Nine". Video shows the nine square grid but only within space of the square selected in the previous grid
Speaker says "Two". Video shows the nine square grid but only within space of the square selected in the previous grid so that focus is on 'Cancel' button
Speaker says "Click". Video shows selection of 'Cancel' button and confirmation overlay appears
Speaker says "Mouse grid". Video shows a new nine square grid covering entire screen
Speaker says "Two". Video shows the nine square grid but only within space of the square selected in the previous grid
Speaker says "Nine". Video shows the nine square grid but only within space of the square selected in the previous grid
Speaker says "Two". Video shows the nine square grid but only within space of the square selected in the previous grid so that focus is on the 'Discard' button
Check your knowledge with the following interaction:
This Topic is available in the following Module:
Want to help us improve this content?