headers
whitehall s.g. (sgw1g10 | 29 Jun 2012 21:15
Picon
Gravatar

Empty phrase table after running

Hi all,

I'm just getting started with Moses, and have come across a stumbling block trying to train a model
following the instructions (2.2.1) in the manual – train-model.perl looks as though it has no
complaints throughout (although as I said, I'm new to this, and may be missing something), but the phrase
table at ~/unfactored/model/phrase-table.gz extracts to a completely empty file.

I've had to modify the command slightly from the documentation, to account for a) absolute locations for
each of the files, b) the --external-bin-dir argument, so the command I ran was:

train-model.perl \
--corpus /Users/sam/mosesdecoder/factored-corpus/proj-syndicate.1000 \
--root-dir unfactored \
--f de --e en \
--lm 0:3:/Users/sam/mosesdecoder/factored-corpus/surface.lm:0 \
--external-bin-dir /Users/sam/moses-external-bins

I noticed this issue was addressed on the mailing list on 12th June ("Empty phrase-table"), but I'm only
using absolute directories, and my log shows no signs of script location mismatch (although I don't
understand about 80% of the output, so I'm likely missing something!). I've attached the output log, so
hopefully someone who's less of a novice may see something wrong,

I'm able to decode from the sample phrase table (seemingly) without issue, if that helps at all.

Thanks in advance,
Sam


***** 2 runs. (algorithm:TA)*****
(Continue reading)

Permalink | Reply |
headers
Hieu Hoang | 30 Jun 2012 16:01
Picon

Re: Empty phrase table after running

the root-dir directory still looks relative to me.

i should reiterate. If you're just running vanilla moses, I suggest you try the EMS (experiment management system) which takes care of running each and every step for you. The many command line args to are fiddly to get right. You can still see exactly how things are run from its log files. 

You can find some info about the ems here
   http://www.statmt.org/moses/?n=FactoredTraining.EMS
You can see an example of a config file for it in the directory
   scripts/ems/example

On 29/06/2012 20:15, whitehall s.g. (sgw1g10) wrote:
Hi all, I'm just getting started with Moses, and have come across a stumbling block trying to train a model following the instructions (2.2.1) in the manual – train-model.perl looks as though it has no complaints throughout (although as I said, I'm new to this, and may be missing something), but the phrase table at ~/unfactored/model/phrase-table.gz extracts to a completely empty file. I've had to modify the command slightly from the documentation, to account for a) absolute locations for each of the files, b) the --external-bin-dir argument, so the command I ran was: train-model.perl \ --corpus /Users/sam/mosesdecoder/factored-corpus/proj-syndicate.1000 \ --root-dir unfactored \ --f de --e en \ --lm 0:3:/Users/sam/mosesdecoder/factored-corpus/surface.lm:0 \ --external-bin-dir /Users/sam/moses-external-bins I noticed this issue was addressed on the mailing list on 12th June ("Empty phrase-table"), but I'm only using absolute directories, and my log shows no signs of script location mismatch (although I don't understand about 80% of the output, so I'm likely missing something!). I've attached the output log, so hopefully someone who's less of a novice may see something wrong, I'm able to decode from the sample phrase table (seemingly) without issue, if that helps at all. Thanks in advance, Sam

_______________________________________________ Moses-support mailing list Moses-support-3s7WtUTddSA@public.gmane.org http://mailman.mit.edu/mailman/listinfo/moses-support 
_______________________________________________
Moses-support mailing list
Moses-support@...
http://mailman.mit.edu/mailman/listinfo/moses-support
Permalink | Reply |

Gmane