Audio - Speech Recognition

How To Add This Control To Your Project

Step #1) Load the most recent release of EZ-Builder
Step #2) Press the Project tab from the top menu bar of EZ-Builder
Step #3) Press Add Control from the button ribbon bar of EZ-Builder
Step #4) Choose the Audio category tab
Step #5) Press the Speech Recognition icon to add the control to your project


This control uses the default audio device and listens for known phrases. Phrases are manually configured in the Config menu, and custom actions (via script) are assigned to your phrase.

Most robots make a lot of noise, so locating the input sound device in the robot is not a practical solution. It is best to locate the microphone on the controlling PC/Laptop or somewhere in the room away from noise. Turning the gain higher on the input device will allow voices to be recognized from across large rooms but will also increase false positives. Test with different gains for the best resolution. Expirement with different microphone locations and volumes for the best setup of your environment. Ideally, use a headset or Bluetooth mic rather than your laptop microphone.

Adjust Mic Input Volume

You might have to adjust the microphone input volume/gain. To adjust the mic volume use the Microsoft Windows volume mixer, and first make sure you have selected the correct input device. Your laptop or computer may have a few different mic devices. Maybe one is on a remote camera? Maybe even your monitor via HDMI? Find the mic you'd like to use and adjust the volume. We find this volume setting to be ideal on our test laptops:

1) right click on the little speaker on your system tray

2) Select "Recording Devices"

3) On the Recording tab of Sound, you'll notice a little VU meter beside the active device. Make sure your active device is indeed the microphone you want to use. By making sounds, the VU meter should move.

4) Double Click on the active device and there is a "Levels" tab for the microphone volume. I have my volume set for 78. Play around with different volumes until you see your voice is being picked up by the VU meter.

Adjust the volume input level/gain to display the voice volume near the middle of the VU Display graph. If the level/gain is too high, the recognition software will not work because the input audio will be distorted.

Usage Notes

*Note: This feature is only available from Windows 7 and newer (7, 8, 8.1, 10, etc.). For a detailed description of what errors your computer is receiving during Speech Recognition Init, open the DEBUG window under Utilities. Microsoft has provided assistance to configure speech recognition, which you can find using Google or here.

*Note: Languages support by speech recognition depend on the Microsoft Windows operating system configuration. View the Microsoft speech recognition guide here to view supported languages.

*Note: If you are a Windows 8.1 user and having trouble with changing to 3rd party voices, consult Steve's tutorial here

Voice Training

You may train your computer for speech recognition by using the training wizard. Find the training wizard under Speech Recognition within the Windows Control Panel.

Headset or External Mic

Using a headset or external mic will produce dramatically better results compared to the internal PC/Laptop mic. Using a headset or mic will enable the recognition engine to "hear" your voice much clearer with less background noise. The background noise of the laptop, motors, radio, and room echo will cause the recognition software to return False Positives. This means the software recognizes an incorrect phrase. An external mic will also prevent the recognition software from hearing the robot speak. In short, it is important to use a Mic Headset or external Mic for a positive Speech Recognition experience.


Like all controls in EZ-Builder, the configuration window can be accessed by pressing the gear icon. The configuration window is where you enter the phrases which will be recognized, and the command associated with each phrase. The EZ-Script tutorial explains how to edit and create commands. You will fine tutorials in the learn section of this website, which can be accessed by pressing the learn button from the top menu of this webpage. You may notice Low Confidence messages during detection. This is most likely due to the fact that you're not using a headset, as recommended in this manual page. However, if you wish to continue using the internal Mic on your PC/Laptop, the confidence can be adjusted to a lower value. Adjusting the confidence to a lower value will produce false positives.


EZ-Builder uses the Microsoft Speech Recognition included with Windows. All languages supported by Windows Speech Recognition are also supported in EZ-Builder. Configure Windows to listen to any language. EZ-Builder will default to EN-US (English) language, if installed. Otherwise, EZ-Builder will default to the first installed language. If more than one language is installed, a language may be selected with the dropdown in the Speech Recognition's configuration menu.



Related Tutorials & Activities



SyntaxHighlighter.all(); There's an important bit of information to recognize when using EZ-Builder. That information is regarding what a control is. Within the EZ-Builder project desktop,...

Last Modified on 1/28/2017

Created by EZ-Robot

Movement Panels

Movement Panels

One of the powerful features of EZ-Builder is the concept of Movement Panels. A Movement Panel is a control which is responsible for how your robot moves in directions (forward, left, right, stop, r...

Last Modified on 2/11/2017

Created by EZ-Robot

RGB Animations

RGB Animations

This RGB LED block and JD's eyes contains 18 RGB LEDs (that means 54 LEDs in total), and plugs directly into the ez-bv4 Wi-Fi Robot Controller. Each LED's color and brightness can be adjusted indivi...

Last Modified on 5/14/2015

Created by EZ-Robot

Microsoft Cognitive Emotion

Microsoft Cognitive Emotion

How would you like your robot to know if you're happy or sad? This lesson demonstrates how to do just that, using the Microsoft Cognitive Services Plugin for EZ-Builder. Learn more about the plugin...

Last Modified on 12/13/2017

Created by EZ-Robot

Microsoft Cognitive Vision

Microsoft Cognitive Vision

Join the Robot overlord DJ Sures and Professor E as they demonstrate how to use the Microsoft Cognitive Vision plugin with EZ-Builder and Revolution EZ-Robots. This episode teaches machine learning...

Last Modified on 12/13/2017

Created by EZ-Robot

Program Robot to Dab

Program Robot to Dab

Introduction Ever seen a robot do The Dab? Robot Overlord DJ Sures and special guest Kyra show you how to create The Dab animation with JD using the Auto Position control. Once the animation is com...

Last Modified on 6/2/2017

Created by EZ-Robot

Speech Recognition

Speech Recognition

Learn how to control your robot using speech recognition. What You Will Need JD, Six, Roli, AdventureBot or Developer Kit Windows PC with EZ-Builder installed [trp:45]

Last Modified on 8/17/2017

Created by EZ-Robot

Randomizing Answers in Speech Recognition

Want to make your robot respond more naturally and not the same thing every time? Here's how to make it answer differently every time! [PDF]

Last Modified on 9/15/2015

Created by Cardboard Hacker

Speech Recognition Say It Didn't Understand You

The speech recognition uses a confidence level to determine if it understood your verbal command. This tutorial demonstrates how to add a response to the speech recognition if it does not understand you, and asks to repeat the command. [PDF]

Last Modified on 1/13/2016

Created by ezrobot

Synbot Plugin Tutorial - interface to Syn Bot Software

How To install bot software, EZ builder Synbot plugin and example SIML project files [PDF]

Last Modified on 3/20/2018

Created by Jlucben

Speech recognition tutorial

Speech recognition is becoming a very popular way to control robots. This tutorial will explain the EZ-Builder speech recognition control in detail, and go through the the steps of how to set it up. It will also include further information such as explaining the controls, training Windows Speech Recognition, and general information on using speech recognition successfully. [PDF]

Last Modified on 3/18/2018

Created by Steve G

Related Articles: N/A