Speech Recognition Engines

Flat
Voxforge tutorial Step 6 - HERest - Cannot open source file dx
User: ralfherzog
Date: 1/14/2009 10:05 am
Views: 19958
Rating: 9

Hi Ken,

Currently, I am examining HTK. I am following the Voxforge tutorial (I am using different path names - the folder "voxforge31" contains the sample files sample1.wav, sample1.mfc, codetrain.scp, config, dict, prompts, etc.). At step 6, I have a problem with HERest - I can't find the mistake. This is written in the terminal:

ubuntu@ubuntu-desktop:~/voxforge31$ HERest -A -D -T 1 -C config -I phones0.mlf -t 250.0 150.0 1000.0 -S train.scp -H hmm0/macros -H hmm0/hmmdefs -M hmm1 monophones0
[...]
ERROR [+5010]  InitSource: Cannot open source file dx
  ERROR [+7010]  LoadHMMSet: Can't find file
  ERROR [+2321]  Initialise: LoadHMMSet failed
 FATAL ERROR - Terminating program HERest
ubuntu@ubuntu-desktop:~/voxforge31$

Any idea what's wrong?

The folder "voxforge31" contains the files train.scp and phones0.mlf. I don't know what's wrong. I have read this and this discussion, but I couldn't find a solution to my problem.

Thanks for your help. Greetings, Ralf

--- (Edited on 2009-01-14 10:05 am [GMT-0600] by ralfherzog) ---

Re: Voxforge tutorial Step 6 - HERest - Cannot open source file dx
User: kmaclean
Date: 1/14/2009 12:03 pm
Views: 111
Rating: 7

Hi Ralf,

>ERROR [+5010]  InitSource: Cannot open source file dx

Please post the contents of your phones0.mlf and train.scp files. 

HTK can be very finicky with respect to file paths and not give very helpful error messages. 

It might be easier to replicate the VoxForge Tutorial folders inside your voxforge31 folder until you get the hang of things, since the tutorial uses relative paths in some of its config files.

Ken

--- (Edited on 1/14/2009 1:03 pm [GMT-0500] by kmaclean) ---

Re: Voxforge tutorial Step 6 - HERest - phones0.mlf - train.scp
User: ralfherzog
Date: 1/14/2009 3:35 pm
Views: 84
Rating: 10

Hi Ken, here are the contents of the files phones0.mlf and train.scp. I tried several variants (with a blank line at the end of the files, different path expressions), but I wasn't successful.

--- (Edited on 2009-01-14 3:35 pm [GMT-0600] by ralfherzog) ---

Re: Voxforge tutorial Step 6 - HERest - phones0.mlf - train.scp
User: kmaclean
Date: 1/14/2009 7:50 pm
Views: 125
Rating: 10

Hi Ralph,

>ERROR [+5010]  InitSource: Cannot open source file dx

Searching the HTK mail archives is helpful sometimes:

[   ] htk-users.mbox 12-Jan-2009 12:12 23M
[   ] htk-users.mbox 12-Jan-2009 12:12 23M

There is a post dated Wed, 26 Sep 2001, with the subject: "Re: [HTK-Users] HERest on step 6"  which might be helpful:

I think the problem is that for some reason you've defined phones in
both uppercase and lower case (I saw this in a previous email).  Firstly
I don't understand why you would want to do this, and secondly if you do
this you must make sure that every phone (upper and lower case) has an
hmm.

Will

dev jhala wrote:
>
> hello everybody!!!!!
> HERest on step - 6 is giving me hard time with
> following error:
>
> C:\HTK-3.0\htk>HERest -C config -I phones0.mlf -t
> 250.0 150.0 1000.0 -S train.scp -H
> /HTK-3.0/htk/hmm0/macros.txt -H /HTK-3.0/htk/hmm0/h
> mmdefs -M hmm1 monophones0
>   ERROR [+5010]  InitSource: Cannot open source file D
>   ERROR [+7010]  LoadHMMSet: Can't find file
>   ERROR [+2399]  Initialise: LoadHMMSet failed
>  FATAL ERROR - Terminating program HERest
>
>  i think my macros and hmmdefs is right i.e. as per
> tutorial. it may be a problem related with path but
> still the above error doen't give me any clue to go
> further. i am using win-2000.
> please have a look of this and write me back.
> thank you so much for all help i get till date
> thanks
> dev
> A & T state uni.
> Greensboro,
> Norht Carolina

So it looks like you might have forgotten to define a 'dx' phone in your "flat start" hmmdef.

Ken

--- (Edited on 1/14/2009 8:50 pm [GMT-0500] by kmaclean) ---

hmmdefs: Do I need really the phone 'dx'?
User: ralfherzog
Date: 1/15/2009 8:10 am
Views: 160
Rating: 10

Hi Ken, thanks for your research. And why isn't the phone 'dx' in the Voxforge tutorial? Take a look at Step 2 - "Confirming Phonetically Balanced Dictionnary": There is no phone 'dx'. Why should I include the phone 'dx' in my hmm0/hmmdefs folder when the Voxforge hmmdefs doesn't have this phone?

Maybe I will try it again using your path propositions.

Edit: I think that maybe I have found the solution: I used VoxForgeDict (contains phone 'dx') instead of the dict file.
I should start again from the beginning. Thanks for your help. I think that you are right that the phone 'dx' is missing.

--- (Edited on 2009-01-15 8:18 am [GMT-0600] by ralfherzog) ---

Re: hmmdefs: Do I need really the phone 'dx'?
User: kmaclean
Date: 1/15/2009 9:06 am
Views: 179
Rating: 9

Hi Ralf,

From ticket#52 Update How-to and Tutorial dictionnary to use CMU dictionnary:

The pronunciation dictionary used in the Tutorial and How-to is based on the ISIP Switchboard corpus (contains around 27,500 words). Whereas the QuickStart and nightly AM builds is based on version 0.6 of the CMU Pronunciation Dictionary (contains around 130,000 words). Unfortunately, the Switchboard and CMU pronunciation dictionaries use slightly different phoneme syntax. This is enough to make them incompatible from a Grammar and Acoustic Model testing perspective.

Ken

--- (Edited on 1/15/2009 10:06 am [GMT-0500] by kmaclean) ---

dictionaries "use slightly different phoneme syntax"
User: ralfherzog
Date: 1/15/2009 10:07 am
Views: 4759
Rating: 8

Hi Ken! OK, I understand. The dictionaries "use slightly different phoneme syntax". Without your help, I wouldn't have found the solution to the 'dx' problem.

Maybe you understand why I am a fan of PLS/IPA. In my opinion, it would be helpful if someone would convert the CMU pronouncing dictionary into the PLS/IPA standard. So that the problems with phoneme syntax can be avoided. By the way, have you tested Simon 0.2? It can import a PLS/IPA dictionary.

--- (Edited on 2009-01-15 10:07 am [GMT-0600] by ralfherzog) ---

Re: dictionaries "use slightly different phoneme syntax"
User: kmaclean
Date: 1/15/2009 11:20 am
Views: 204
Rating: 10

Hi Ralf,

>By the way, have you tested Simon 0.2? It can import a PLS/IPA dictionary.

Not yet, busy with other things  :)

Ken

--- (Edited on 1/15/2009 12:20 pm [GMT-0500] by kmaclean) ---

Re: Voxforge tutorial Step 6 - HERest - phones0.mlf - train.scp
User: Pramod
Date: 2/11/2009 11:41 am
Views: 265
Rating: 7

hi,

i get the same error:  ERROR [+5010]  InitSource: Cannot open source file b

but i do have an entry for "b" in the hmmdefs file. also when i delete the entry "b" from the monophones0 and run again, i get the same error on another letter, and so on for every entry in the monophones0.

i am following the HTKBook tutorial and using the BEEP dictionary. can you please tell me what is going wrong here. thanks.

PRAMOD SANKAR

--- (Edited on 2/11/2009 11:41 am [GMT-0600] by Visitor) ---

Re: Voxforge tutorial Step 6 - HERest - phones0.mlf - train.scp
User: kmaclean
Date: 2/12/2009 10:19 am
Views: 113
Rating: 10

Hi PRAMOD,

Are you creating Flat Start Monophones similar to the approach used in Step 6 of the VoxForge tutorial (i.e. you manually created phone entries in your hmmdef file)? 

Have you double checked the syntax you used?  It my be easier to try creating the hmmdef file again in case there is some difficult to see error that you have propagated in the creation of your flat start hmmdef file.

Ken

--- (Edited on 2/12/2009 11:19 am [GMT-0500] by kmaclean) ---

PreviousNext