HEARSAY GOLD INSTALLATION AND OPERATION MANUAL BOOK TWO: VOICE RECOGNITION TABLE OF CONTENTS SECTION TITLE 1.00 HOW TO SETUP THE HEARSAY GOLD RECOGNITION SOFTWARE 1.01 HOW TO SET THE HEARSAY GOLD LEVEL AND TEST VOCABULARY 1.02 HOW TO USE THE HOT KEY 1.03 HOW TO ENABLE/DISABLE VOICE RECOGNITION 1.04 HOW TO USE THE TEST VOCABULARY 2.00 HOW TO CREATE HEARSAY GOLD VOCABULARIES 2.01 HOW TO SELECT WORDS IN YOUR VOCABULARY 2.02 HOW TO DEFINE HEARSAY GOLD VOCABULARIES 2.03 HOW TO TRAIN HEARSAY GOLD VOCABULARIES 2.04 HOW TO SAVE HEARSAY GOLD VOCABULARIES 2.05 HOW TO LINK HEARSAY GOLD VOCABULARIES 2.06 HOW TO EXIT HEARSAY GOLD EDITOR & RETURN TO DOS 3.00 HOW TO LOAD HEARSAY GOLD VOCABULARIES 3.01 HOW TO LOAD HEARSAY GOLD VOCABULARIES FROM DOS 3.02 HOW TO LOAD HEARSAY GOLD VOCABULARIES WITH AN APPLICATION 4.00 HOW TO USE THE HEARSAY GOLD WINDOW SYSTEM 4.01 HOW TO OBTAIN THE HEARSAY GOLD VOCABULARY WINDOW 4.02 HOW TO OBTAIN THE HEARSAY GOLD CONTROL WINDOW 4.03 HOW TO USE THE HEARSAY VOICE COMMANDS 4.04 HOW TO USE THE HEARSAY GOLD IN GRAPHICS MODE 4.05 HOW TO USE THE SAMPLE VOCABULARIES 5.00 HOW TO EDIT EXISTING HEARSAY GOLD VOCABULARIES 5.01 HOW TO LOAD HEARSAY GOLD VOCABULARIES INTO THE EDITOR 5.02 HOW TO USE THE HEARSAY EDITOR 5.03 HOW TO EDIT 6.00 HOW TO CREATE A BATCH FILE & MANUALLY CONFIGURE THE HEARSAY GOLD 6.01 HOW TO MANUALLY CONFIGURE THE HEARSAY 6.02 HOW TO CREATE HEARSAY BATCH FILES APPENDIX A * USING A MOUSE * HOW TO USE THE HEARSAY GOLD WITH A MOUSE * HOW TO USE THE MICROSOFT MOUSE MENUS * HOW TO ADJUST MOUSE SENSITIVITY INTRODUCTION The Hearsay Gold voice recognition system is a multi-functional command, control, and voice communication interface for the IBM PC. It combines, in a single integrated hardware/software package, facilities for voice command and control of standard applications programs, fast and efficient command selection from on-screen "Pop-up" windows, and voice prompts. As a bonus, Hearsay Gold also provides mouse users with a transparent mouse driver that enables the mouse to be used for cursor control and menu selection in most application programs running under PC-DOS. By integrating all of these functions into a package, a simple, consistent interface is provided for the user. Book Two explains how to install and use the Hearsay Gold Recognition Software for the IBM Personal Computer. It is divided into many sections. SECTION ONE is designed to get you started with the system quickly. It is tutorial in nature and makes use of examples to teach the basics of operation. SECTION TWO explains how to create your own vocabularies while SECTION THREE explains how to load these vocabularies. SECTION FOUR, the operation guide, serves to document the operation of the Hearsay program in detail. This section explains all program options and modes of operation. It also explains the sample vocabularies provided on your system disk, and describes how to load and use them. SECTION FIVE documents how to edit existing vocabularies. SECTION SIX explains manual configurations and creation of batch files. APPENDIX A describes the interafce between the software and a Microsoft compatible mouse, and discusses the use of the Microsoft Mouse Menu package with Hearsay. 1.00 HOW TO SET THE HEARSAY GOLD VOICE RECOGNITION SOFTWARE 1.01 HOW TO SET THE HEARSAY GOLD LEVEL & TRAIN THE TEST VOCABULARY This program will automatically set the microphone level to a value appropriate for the environment where you will use Hearsay. It determines an appropriate noise level and sets the level in the recognition driver. When recognition is enabled, the level takes effect. You should not talk or make any noise at step 4, when pressing [ENTER] and saying "CALIBRATE", as the program checks the background noise level during this period. TO SET THE LEVEL NOTE: The software includes step by step procedures and when prompted at any time to strike a key to continue, please do so. These prompts have been excluded from the following directions. STEP ACTION 1. Type SETUP [ENTER] NOTE: The Level position should be set only once in the environment where you will be using the Hearsay Gold system. If the environment changes or the computer is moved to a different environment, the level must be reset and the vocabularies retrained by each new user. 2. Enter your three (3) initials (XXX) [ENTER] NOTE: If these initials already exist, the system will caution you that someone with these initials has already set the level. Using these initials will reset the existing level setting that may not be yours. It gives you the option to RESET (R), enter new INITIALS (I) or EXIT (E). 3. When prompted, press the [ENTER] key, pause a moment and say the word CALIBRATE in a normal voice. 4. The system then asks you to read the message above the arrows and below the Press the Enter Key and say CALIBRATE line. If the background level is 4 or higher or if the system is warning you with one of the following: WARNING! LOW SPEECH LEVEL RECOGNITION PERFORMANCE MAY BE IMPAIRED or WARNING! SPEECH LEVEL IS LOW IN RELATION TO BACKGROUND LEVEL RECOGNITION PERFORMANCE MAY BE IMPAIRED If the message appears, press [Y] for Yes. NOTE: If either message appears, it means the system did not hear you or there is too much noise and automatically goes back to step 4. If this happens more than five times, the system has become defective. CAUTION: If either message DOES NOT appear check the following settings: Background Level Speech Level The background level is optimum at 0 but can be as high as 2 or 3 for good performance. The speech level should be between 15-25. If any of your level level settings are out of these ranges press [Y] for yes and repeat step 4 until no messages appear and your settings are in the proper range. If everything is okay press [E] to continue. 5. After the Level has been set, the system will automatically prompt you to say each word of the Test Vocabulary as it appears at the bottom left portion of the screen. 6. Repeat each word that appears when prompted. The system will repeat the vocabulary twice. NOTE: The Hearsay Gold should be spoken to in a similiar fashion as when speaking to a dog. A commanding authoritative tone usually results in the best performance. If Hearsay interprets your second training pass as considerably different than the first training pass, you will be prompted to repeat the word again. A word in the vocabulary is printed UPDATE VOCAB, when prompted you may say "UPDATE VOCAB" or "UPDATE VOCABULARY". Three STARTUP BATCH files will automatically be created with the three following names: XXX - is your three initials. XXX - Creates a startup file that sets your personal directory and loads the voice recognition driver HSR (See Section 6.00 Manual settings). XXXE - Creates a startup file that sets your personal directory and loads the Voice Recognition driver HSRE (See Section 6.00 Manual Settings). "XXXETEST" - Creates a startup file that sets your personal directory and loads the Voice Recognition drives HSRE and loads the TEST vocabulary. These startup files are loaded first when creating, loading or editing Hearsay vocabularies. NOTE: If the directory Hearsay has not been added to the path you must first change to the Hearsay directory before loading these startup files. 1.02 HOW TO USE THE HOT KEY The HOT KEY is a key that is used to enter HEARSAY'S Vocabulary & Control Windows described below. It can also be used to temporarily disable voice recognition. Hearsay's default HOT KEY is the GRAY-PLUS or NUM-PLUS key on the numeric keypad. Note that this key is not the same as holding down the shift key and equal sign on the main keyboard. Since Hearsay Gold reverses the numeric + key for its use, one must use the [SHIFT-=] to enter a + sign. To change the default HOT KEY setting see Section 5 or 6. 1.03 HOW TO ENABLE/DISABLE VOICE RECOGNITION Voice Recognition is enabled from the Control Window which is described in Section 4.02. STEP ACTION 1. To obtain the Control Window press the "HOT KEY" twice and note that the cursor will appear on the 'Enable Voice' option. NOTE: The default HOT KEY to toggle between the Vocabulary Window (Described in Section 4.01) & Control Window is the "Gray + Key" on the numeric keyboard. TO ENABLE VOICE RECOGNITION STEP ACTION 1. Press the "HOT KEY" twice. 2. Press the [ENTER] key. NOTE: The Hearsay system toggles between Enable & Disable Voice Recognition. To disable, repeat steps 1 & 2 above. 1.04 HOT TO USE THE TEST VOCABULARY The Test Vocabulary is used in order to familiarize a user the appropriate way of speaking to the Hearsay system. To load: STEP ACTION 1. Type CD\HEARSAY [ENTER] to change to the Hearsay directory. 2. Type XXXETEST [ENTER] to load your personalized Vocabulary. 3. Enable voice recognition by use of the HOT KEY (Described above). 4. Repeat the following test vocabulary words below one at a time. NOTE: The Hearsay Gold should be spoken to in a similiar fashion as when speaking to a dog. A commanding authoritative tone, usually results in the best performance. SIT LIE DOWN ROLL OVER COME HERE PLAY DEAD STAND UP HEEL TALK UPDATE VOCAB After repeating a word the word will be printed to the screen as displayed above. Once 100% accuracy is achieved for four or five passes for each word, you will be speaking to the Hearsay Gold properly. To return to DOS, press [ENTER]. TO UPDATE THE VOCABULARY Every time you speak to the Hearsay Gold it automatically updates your stored words in memory. This means that the system is becoming more familiar with your voice. In order to save those updates to your hard drive, say the words UPDATE VOCAB or UPDATE VOCABULARY aloud. NOTE: It is wise to update your vocabulary a few times during the day before turning off your computer or loading another vocabulary.