VoxForge
How many times do I need to record a phoneme so that HTK can compile it to an Acoustic Model?
You need to record a particular word from your Grammar more than once in order to create HMM statistical models that are robust enough to recognize your voice - more is better, 3 to 5 is the minimum required so that HTK will compile.