ÿ3.00 HOW TO LOAD VOCABULARIES 3.01 HOW TO LOAD VOCABULARIES FROM DOS The Hearsay Gold recognition software consists of two drivers (XXX and XXXE), two editors (REDT and RE) and a program that creates a Library (MKLIB). In order to load a vocabulary one of the drivers must first be loaded. Next a Library must be created. A Library is the place where Vocabularies are stored in memory so they can be accessed quickly. The Editor REDT automatically creates a Library upon loading and the Library is expanded to the neessary size to store the vocabularies loaded. The Editor RE is used in conjunction with MKLIB upon loading and does not create a Library. MKLIBXX allows space to be allocated manually by specifying a number XX, where XX represents the number of kilo bytes of memory. Loading a large number of vocabularies into the Library will leave less room for application programs if you are using them. The amount of Library space required to store a vocabulary is a function of the vocabulary size. The first 64 word vocabulary requires 25K bytes & each additional 64 word vocabulary requires 12K bytes. NOTE: If MKLIB is used, the REDT will add additional space in the LIBRARY if needed to fit the vocabularies. LIBRARY MEMORY UTILIZATION Be aware that the Hearsay Gold Library can use substantial amounts of user memory. Each Hearsay Gold vocabulary loaded will occupy between 1 and 12K bytes of user memory. If you plan on keeping a large number of vocabularies resident, make sure that you have a decent amount of memory available. The XXX driver requires about 70K bytes of memory. XXXE used to edit your vocabulary within your application program requires an additional 40K of memory. If you do not need access to editing functions within an application program. we recommend you load your files with the XXX command. Since the Library is automatically extended to accomodate the vocabularies that the user loads, very large Libraries can be used. One limitation on the use of Libraries is that a maximum of 64 vocabularies can be stored in the Library at any one time. You can load vocabularies in of two ways. The most efficient from DOS described below or from within the Hearsay Editor as described in Sections 5.01 and 5.02. TO LOAD FROM DOS STEP ACTION 1. Type CD\HEARSAY [ENTER] 2. Type XXX or XXXE [ENTER] 3. Type REDT/L filename1 filename2 filename3 or MKLIBXX (Where XX specifies the amount of memory to be allocated for the Library in Kbytes). Then type RE/L filename1 filename2 filename3 To clear the Library before loading the vocabularies, the /EL option should be used. Replace step 3 with the following: REDT/EL filename1 filename2 filename3 or with RE/EL filename1 filename2 filename3 (If MKLIB was used) NOTE: If more than one vobaculary is loaded, the vocabulary names must be seperated by spaces. You can load from 1 to 10 vocabularies (Filename1 to filename10) together at a time in this manner up to 64 vocabularies. UPON COMPLETION OF THE ABOVE COMMAND THE CURRENT VOCABULARY WILL BE THE LAST ONE IN THE LIST. If you are loading linked vocabularies, any vocabulary linked to any other must be loaded into the library at this time. Alternately the REDT program accepts a vocabulary list in a file which is loaded on execution. The name of the vocabulary list should be preceded by an @ character and should appear in place vocabulary files seperated by spaces. Multiple lines may also be used as desired. For example, to erase the Library and load the vocabularies listed in file EXAMPLE.LST, the command line would be REDT/EL@EXAMPLE.LST This file must be created with a DOS Editor, refer to your DOS manual. NOTE 1: When storing vocabularies in a list file, the maximum number is 8 vocabularies. Additionally a 47K limit is all that can be loaded. If these limits are exceeded, load two seperate list files. (ex. REDT/L@EXAMPLE1.LST,REDT/L@example2.LST). NOTE 2: The list file must be stored in the DIRECTORY where the environment is set to. 3.02 HOW TO LOAD HEARSAY GOLD VOCABULARIES WITH AN APPLICATION In order to load a vocabulary with an Application program you must always load the Hearsay system first BEFORE your application program. If you are using a menu or shell program you must exit to DOS and load Hearsay first. To load, follow the directions "To Load From DOS" above then load your application as specified in the application loading instructions. 4.00 THE HEARSAY GOLD WINDOW SYSTEM 4.01 HOW TO OBTAIN THE HEARSAY GOLD VOCABULARY WINDOW THE VOCABULARY WINDOW A Hearsay Gold Vocabulary relates a series of command names to specific sequences of keystrokes that are automatically typed when the commands are either spoken or selected from the Vocabulary Window. If we Load the Test Vocabulary by Typing: STEP ACTION 1. Type CD\HEARSAY [ENTER] 2. Type XXXETEST (XXX=your initials)[ENTER] To see the TEST Vocabulary Window, press the "HOT KEY" (The gray + key on the numeric keypad). When the "HOT KEY" is pressed, the active Vocabulary appears in the lower left corner of the Vocabulary Window. The vocabulary name shown should be <>. If the window shown is <>, there is no vocabulary currently loaded or you pressed the HOT KEY two times. Try again or go back to step 1. EXECUTING COMMANDS FROM THE VOCABULARY WINDOW After pressing the HOT KEY once and entering the Vocabulary Window: STEP ACTION 1. Press the cursor keys to move the highlighted selection up, down, left, and right to a desired function. 2. Press [ENTER] key. The currently highlighted command will be executed. Press "HOT KEY" a second time. A window called <> will appear. The Control Window will be discussed next. If the "HOT KEY" is pressed again, the Control Window will disappear. Stepping through the control menu is a very convenient way to exit from the Vocabulary Window without executing a command. Pressing the "HOT KEY" nevers causes a command to be executed, it merely brings up window options. Additionally, when the menus appear on the screen voice recognition is disabled temporarily, when exiting these menus if voice recognition was enabled it will then again be enabled. 4.02 HOW TO OBTAIN THE HEARSAY GOLD CONTROL WINDOW The Control Window allows you to execute the following options: * ENABLE / DISABLE voice recognition * Change or view the vocabularies within the Hearsay Gold LIBRARY * Load the active vocabulary in the Library into the EDITOR * QUIT to exit the Control Window STEP ACTION 1. Press the "HOT KEY" two times ENABLE / DISABLE VOICE RECOGNITION The ENABLE VOICE mode of the Hearsay Gold system allows any words listed in the vocabulary menu to be executed by saying their names. This feature can be combined with conventional keyboard entry, mouse command selection, and conventional keyboard enhancement functions. NOTE: We highly recommend that the voice function be disabled when it is not in use. This prevents other sounds from being mistaken for voice commands. STEP ACTION 1. Obtain the Control Window by hitting the "HOT KEY" twice. If the voice mode is currently disabled, the first selection will read: ENABLE VOICE If the voice mode is currently enabled, the first selection will read: DISABLE VOICE. 2. Position the cursor to this selection. 3. Press the [ENTER] key. 4. Press the "HOT KEY" to remove the Control Window. NOTE: If enabling the voice, the vocabulary will now be ready for use. To execute a command, you must say its name. Voice Commands will only be accepted while the Hearsay Gold voice is ENABLED and the Control and Command Windows are exited. Additionally, the computer must be waiting for a keyboard input. TO VIEW VOCABULARIES WITHIN THE LIBRARY STEP ACTION 1. Obtain the Control Window. 2. Select LIBRARY option by moving the cursor over it & pressing [ENTER]. The names of the vocabularies will now be displayed in the LIBRARY Window. TO CHANGE THE ACTIVE VOCABULARY IN THE LIBRARY STEP ACTION 1. Obtain the Control Window. 2. Select LIBRARY option by moving the cursor over it & pressing [ENTER]. 3. Move cursor to select one of the listed vocabularies & press [ENTER]. NOTE: This will change the selected vocabulary to the active vocabulary which is now displayed in the vocabulary window and can now be activated by voice commands if voice is enabled. LOAD THE CURRENT VOCABULARY INTO THE EDITOR NOTE: This option is only available when loading the XXXE startup batch file or from the HSRE Hearsay driver described in Section 6. STEP ACTION 1. Obtain the Control Window and select the EDITOR option. The active vocabulary will now be loaded into the on screen Editor. QUIT THE CONTROL WINDOW STEP ACTION 1. Move Cursor to Quit and press [ENTER]. NOTE: Pressing the "HOT KEY" once from within the CONTROL Window will also exit the CONTROL Window. 4.03 HOW TO USE THE HEARSAY GOLD VOICE COMMANDS Once voice control is turned on, all you need to do to execute a command is to say its name. Voice commands will be accepted however, only when the computer is waiting for you to type something. Voice commands are not active while the Vocabulary or Control Windows appear on the screen. After you have created, trained & loaded your vocabulary with your applications, voice commands can be used. To describe the features of the Hearsay while in use, we can run the "TEST" program as an example. To do this: Load XXXETEST (XXX = your initials). PAUSING THE RECOGNIZER If you wish to temporarily disable voice recognition for any reason, bring up the Vocabulary or Control Windows by pressing the "HOT KEY". Hearsay Gold will not recognize voice commands while the Vocabulary or Control Windows are on the screen. To continue, simply exit from the Hearsay Gold windows by pressing the HOT KEY until the windows disappear. The pause feature is most often used when the user needs to cough, sneeze, or speak while the system is in use. The user is free to choose between disabling the recognizer permanently from the Control Window or pausing it by use of the HOT KEY. REJECTION OF WORDS If a beep is heard after you say a word, the word has not been recognized. If this happens, say the word again. If the system refuses to recognize only a few words or executes the wrong command for those words, those words probably need to be retrained (See section 5.03 - How to Edit). If the system refuses to recognize the majority of the words, or if constantly executes the wrong commands, one of the following is probably at fault: 1. The correct vocabulary is not active. Check which vocabulary is active by bringing up the Control Window and selecting the Library option. 2. The vocabulary loaded has not been trained for the current user. Check to see that your personalized vocabulary file has been loaded. 3. The microphone is not positioned correctly. Make sure the white dot is facing the corner of your mouth, slightly below your lower lip, below the breath path. Make sure the microphone is close to your mouth at all times. 4. The word is not in the active vocabulary. 5. Improper level setting. The background noise has changed considerably since the level was set. To check your initial setting: STEP ACTION 1. Type CD/HEARSAY/XXX (XXX=initials). 2. Type LEVEL.SAV The level will be displayed as: LEVEL = XXXX (Where XXXX is a four digit code). TO COMPARE WITH THE CURRENT LEVEL SETTING: STEP ACTION 1. Type SET HEARSAY=C:\HEARSAY 2. Type HSR 3. Type LEVEL The system will now ask you to press the [ENTER] key and say CALIBRATE. It will now display the current microphone level. If the initial setting is + or - 10 points different from the current setting, the SETUP program needs to be run and the level setting RESET. If the system does not respond when you say a command, and no beep is heard, try the following: 1. Check that Voice is Enabled by pressing the "HOT KEY" two times. The Control Window should read DISABLE VOICE. 2. Make sure headset or microphone is positioned correctly, & plugged in. 3. Make sure you are speaking at a reasonable level. Anything above a whisper is appropriate in a semi-quite environment. If a desktop microphone is used in a noisy environment (Not a recommended practice), Hearsay Gold may insist that you speak quite loudly. If everything checks out normally, try reinitializing the recognizer as described below. INITIALIZING THE RECOGNIZER To achieve an optimum performance level, the recognizer must adapt to the environment that it is being used in. This kind of adaptation, referred to as recognizer initialization, is performed automatically upon exit from the Control Window. Normally the user does not need to be concerned about this automatic adaptation. It is important however, that the user not be talking, coughing, or clearing his troat, when the Control Window is exited. It is good practice to reinitialize at this point by stepping through the control window if unsatisfactory performance is experienced. AUTOMATIC PAUSE MODE If Hearsay Gold detects continuous speech or loud sounds, such as are produced in conversation, it will automatically pause. This feature protects against extraneous voice input when the user forgets to pause or disable the recognizer. Automatic pause will bring up the Control Window, and the system will wait for a keyboard input, mouse response or pressing the "HOT KEY" before continuing on. NOTE: To permamently disable the AUTOPAUSE MODE see Section 6.01. ADAPTIVE TRAINING The Hearsay Gold has an adaptive training program automatically built in. Simply, the more you speak to your system, the better it gets, or "Adapts" to your voice. However, adaptive training only stores its updates to its internal memory. If the system is unhooked, turned off, or another vocabulary is loaded, these adaptive training updates are lost. It is a wise idea to update your vocabulary a few times during the day. To do so, you must manually save your vocabulary to your hard drive. To do this, see Section 2.04 How To Save Hearsay Gold Vocabulary. A NOTE ON PRINT SPOOLERS Print operations may be used while the Hearsay voice control is ENABLED. However, the printing operation stops if any of the Hearsay Windows are entered by use of the "HOT KEY" or by activating via Auto Pause. If you wish to run a print spooler, DISABLE the voice control mode from the Hearsay Control Window as described in Section 4.02 before printing. If you have already run the spooler and your printer has stopped, you can still disable Hearsay in the normal manner. NOTE: Printer noise may also cause decreased accuracy results if the printer is in close proximity to the Hearsay. 4.04 HOW TO USE THE HEARSAY GOLD IN GRAPHICS MODE Please note the following when using the Hearsay Gold in Graphics mode: * Hearsay Gold is compatible with both monochrome and color graphics display systems including CGA, EGA, and VGA. * The Vocabulary and Control Windows are designed for use ONLY with alphanumeric display modes. * If you are using Hearsay Gold with programs that use the color graphics card in a graphics display mode, the pop-up Vocabulary & Control Windows will not appear however, the voice system will continue to operate normally. * In this mode, the "HOT KEY" acts as a switch that ENABLES and DISABLES VOICE. NOTE 1: The system will beep twice whenever the voice is DISABLED. NOTE 2: No sound is made when the voice is ENABLED. * In programs that employ both graphics and alphanumeric display modes (Such as WordPerfect or Lotus 1-2-3), menus will appear normally whenever the screen is in the alphanumeric mode and as described above when in graphic display mode. 4.05 HOW TO USE SAMPLE VOCABULARIES There is a sample vocabulary provided on the Hearsay Gold system disk. This vocabulary is intended to help get you started using Hearsay Gold with various application packages and are intended to be heavily customized. The commands that are included in the sample vocabulary are general in nature, but the most useful commands in your Hearsay Gold vocabularies will probably be those that you will define yourself. With Hearsay Gold you can make powerful commands that perform such user specific tasks as automatically loading your budget file in a spreadsheet or typing one of a small glossary of words in a word processing program. Before attempting to use the sample vocabulary, you should be familiar with the material in the previous sections of this manual. As discussed in chapter 2, Hearsay vocabularies must be trained to your voice before their initial use. NOTE: After you have trained the vocabulary, SAVE it to a FILE. DOS.VOC Drive A - Sets the default drive to "A:" from the DOS command mode. Drive B - Sets the default drive to "B:" from the DOS command mode. Directory - Runs the DOS directory command "DIR". Clear Screen - Runs the DOS command "CLS" to clear the screen. Enter - Types the [ENTER] key. Escape - Types the [ESC] character. Line Repeat - Types the [F3] key to retype the last DOS command line. Line Save - Types [F5] key to save current DOS line for additional editing TO TRAIN THE DOS VOCABULARY: STEP ACTION 1. Type CD\HEARSAY 2. Type XXX or XXXE 3. Type REDT DOS 4. Select T (TRAIN) then T (TRAIN WORDS) 5. Repeat the words as they appear on the screen when prompted TO SAVE: STEP ACTION 1. Press S (SAVE) then F (FILE) 2. Press [ENTER] 3. Press O (OVERWRITE) 4. Press S (SAVE) then L (LIBRARY) You may now ENABLE VOICE from the Control Window and use your sample vocabulary.