Mouth Movement With Speech

 
#1

I've been investigating switching my InMoov robot over to ez-robot control. I'm liking what I've seen so far.
Question; Is it possible to make the mouth of a robot move in sync with speech/sound with ez-robot software?
Thanks,
Bob

#2

Yes, there is a control in EZ-Builder which moves servos based on streaming audio activity of the EZ-B v4

#3

Great! I think I'm going to order a couple of boards and maybe a Six robot. Is the shipping time realty 5 - 7 weeks? What if I drop buy your shop, can I buy everything there?

#4

@ DJ Sures Yes the Sound Servo widgets work with the sound on the pc and on the v4. I tried it out but have a few issues to ask you about. first i ran a script which setvolume(100) and sayezb(" hello, my name is LEXI"Winky. ran it the servo flutters but not in sync. it actually does the movements faster that the length of speech. how do you sync it? the update speed is at 100 and i used all different scaler values.

#5

BHouson, the parts are being manufactured and assembled right now. They are drop shipped from our manufacturing facility directly to you. There is no inventory in our office, sadly. All we have at the office are 3D printed prototypes and hand soldered prototypes.

#6

@Anthony-XLRobots.com I would try and adjust the servo speed with Servospeed() command. It could be that a script or action may have taken over and is setting the servo speed to a value that is faster than needed.

It's something that I've had to get used to when writing scripts and actions for the v4 as my different animations (actions) usually run at different speeds. I have to reset the speed for most of my scripts to "0" at the beginning to make sure that one script isn't effecting another.

#7

The Servo Sound (EZ-B v4) control does not use actions or positioning - so you will not need to worry about that, unless you have specified servo speeds somewhere else.

The control that Anthony and the original poster is referring to is the Servo Sound (EZ-B). The control will use the audio that is being streamed to the EZ-B v4 to move the servo. The settings are Refresh and Gain. The Refresh speed is how often the audio is sampled to move the servo. The Gain is how much the volume is amplified when converted to servo positions.

Those two numbers will need to be changed.

If you are sending an MP3 file of music, you cannot expect the servo to move with the vocal - because the music is a giant chunk of audio.

You can use the EZ-Script command SAYEZB() to speak audio, and the audio will be streamed through the EZ-B v4 and the Sound Servo (EZ-B) will move the servo to the audio

#8

@dj tried it still no good. simple sayezb hello, how are you make servo twich real quick before sound finishes.

#9

@DJ please correct me if I am wrong since I am assuming based on only what I can see my end and with no EZ-B V4 to test with I'm working slightly blind.

If it's like the PC sound servo it sounds like servo speeds may need adjusting along with the bits DJ mentioned.

If the servo isn't moving correctly then I'd say look at the gain, the servo moves relative to the volume of the audio. If the gain is too low it will barely move, if too high it'll move high and stay there.

I presume it's along the same lines as the bar on a graphic eq. display, when high the servo moves higher, when low it moves lower. If you set up the gain incorrectly it may remain either too low and barely move or too high and barely move.

#10

Maybe slow down the speech - because the sound of the word Hello may be too quick for the servo to respond.