Test Acoustic Model Using HTK

1. You need to tell HTK where all your feature vector files are located (those are the mfcc files you created in the last step).  You do this with with a script file. 

Therefore, create a file called:  test.scp

2. You also need a configuration file.  Create a file called 'config' in your 'voxforge/test' directory and add the following data:

TARGETKIND = MFCC_0_D_N_Z TARGETRATE = 100000.0 SAVECOMPRESSED = T SAVEWITHCRC = T WINDOWSIZE = 250000.0 USEHAMMING = T PREEMCOEF = 0.97 NUMCHANS = 26 CEPLIFTER = 22 NUMCEPS = 12

3. Next use HTK's HVite command to recognize the test data as follows:

a) If you created your Acoustic Model using the How-to or the the Tutorial, execute the following command:

$HVite -A -D -T 1 -H macros -H hmmdefs -C config -S test.scp -l '*' -i recout.mlf -w wdnet -p 0.0 -s 5.0 ../lexicon/voxforge_lexicon tiedlist

b) if you Adapted the VoxForge Speaker Independent Acoustic Models to your voice using the adaptation tutorial, the execute this command (because you adapted using HTK version 3.2.1, then you must use the HTK-3.2.1 version of HVite):

$/home/yourusername/htk-3.2.1/bin.linux/HVite -A -D -T 1 -H macros -H hmmdefs -C config -S test.scp -l '*' -i recout.mlf -w wdnet -p 0.0 -s 5.0 ../lexicon/voxforge_lexicon tiedlist

This will create the following file: recout.mlf

4. Finally, run the following command to determine the actual recognition performance of the Acoustic Model:

$HResults -I testref.mlf tiedlist recout.mlf

which will display output similar to this (note: these are results for the 8kHz:16-bit VoxForge Speaker Independent Acoustic Model - build 396):

====================== HTK Results Analysis =======================   Date: Thu Sep 14 14:11:46 2006   Ref : testref.mlf   Rec : recout.mlf ------------------------ Overall Results -------------------------- SENT: %Correct=60.00 [H=30, S=20, N=50] WORD: %Corr=96.83, Acc=76.19 [H=183, D=0, S=6, I=39, N=189] ===================================================================

What this means is that:

• for the line starting with SENT, there were 50 test sentences and 60% were correctly recognized. 
  
• for the line starting with WORD, there were 189 words in total, of which 96.83% were recognized correctly.  But because Julius recognized words that are not in the audio file (i.e. insertion errors) it only gets a 76.19% accuracy rating.
• Count definitions:
  
• D - Deletion Error
• S - Substitution Error
• I - Insertion Error

---

Comments

Click the 'Add' link to add a comment to this page; click the 'Read More' link to view replies to a posted comment.

Add • Search

By j23 - 7/31/2011 - 4 Replies

 

Hello,

I am using HREsults in order to know how my HTK recogniser works. I am interested in getting base results concerning %WER, %Substitutions(S), %Deletions(D) and %Insertions(I), but always a report of these S, D and I (i.e. the word 'he' has been S by the word 'she' 17 times, etc..).

I have read HTK Book section about HREsults -options, but I do not find the way to do it. Is it possible? I am using a 65K vocabulary (cross matrix does not work well..)

Thank you in advance

Read More