[MUD-Dev] Shift in time

[Robert Zubek]

Arnau Rosselló Castelló wrote:

> I'd like to ask, then, about phoneme recognition and synthesis. My
> idea is to translate a voice input from the into a string of
> phonemes(with pitch, speed and volume hopefully), but not
> translating it to words. Such a stream could be sent to other
> players, and sinthesized with a distinct voice for every
> sex/race/whatever.

>From my experience with existing text/speech tools, it'll be
difficult to get phoneme information out of them - they're really
optimized for recognizing complete words, and their internal
acoustic representation isn't necessarily equivalent to phonemes. :(

However, it's not clear that you *need* phoneme recognition. Since
what you're looking for is speech -> text -> speech, it doesn't
matter if the speech recognition part isn't quite right. Even if it
contains spelling or homophone errors, they don't matter, because
the text is going to get converted back to speech anyway. :)

> How could such a system deal with ambient noise, or tapping the
> mic?

Generally speaking, speech recognition programs are still *very* bad
about background noise, multiple speakers, and unexpected voice
characteristics (e.g. stress in the speaker's voice). But
considering that you're not concerned with getting the *correct*
text representation, it may not matter. My recommendation would be
to go download a few existing speech recognition systems, and see
how they work for you.

> Is there any king of public project(i know about festival only),
> creating these kind of programs? papers maybe?

The NLP community is great about sharing their code - there's a lot
of stuff at: http://registry.dfki.de/

Two free systems that are ready to use, off the top of my head:
Sphinx-II for Unix and Windows:

  http://cmusphinx.sourceforge.net/sphinx2/

Microsoft Speech SDK for Windows:

  http://www.microsoft.com/speech/download/sdk51/

Hope this helps,

Rob

--
Robert Zubek
http://www.cs.northwestern.edu/~rob
_______________________________________________
MUD-Dev mailing list
MUD-Dev at kanga.nu
https://www.kanga.nu/lists/listinfo/mud-dev