Task List

File:EfficientVectorialTagging.docx

Sample script for PTB

python scripts/submit.py -t 1 -P 100 -a 1 -cLS -m 1 -n1 -v -dPTB -xActiveLearner.xml

Sample script for Syriac

python scripts/submit.py -t 1 -P 100 -a 1 -cLS -m 1 -n1 -v -dSyriac -xSyriacActiveLearner.xml -S0,1,2,3,4,5,6,7,8,9,10,11,12 -D#

Script to kill jobs over a certain number of minutes. This kills all .raw files that haven't been updated in the last hour. (Very handy for the running folder).

find . -mmin +60 -name '*.raw' -exec rm {} \;

Delete a series of jobs:

for i in $(seq 1 10 ); do qdel $i; done;

Subversion command on schizo:

svnadmin create name/
svn checkout file:///users/ugrad/p/pjmcclan/subversion/name/

Ignore values in gnuplot:

set datafile missing ?

Set series (line) name:

plot sin(x) title 'sin'

Set plot title:

set title "Plot title"

Put a label on the x or y axis

set xlabel "x axis"
set ylabel "y axis"

Change all file extensions

for f in *.htm; do mv $f `basename $f .htm`.html; done;

Typical rsync commands

rsync -azP

Run voweling on rouge

java -Xmx5000m -Xms5000m -classpath bin:lib/statnlp.jar  edu.byu.nlp.alfa.voweling.VowelClassifier_NEW

Setting eps files in gnuplot

set term postscript color

Running morph Trainer

ant morphTagger -Dmode ="      /ecc.model" -Dtraining="data/syriac/allTraining.txt" -Doutfile="out/ecc.txt"

Running morph tester

ant morphTester -Dmode ="      /independent.model" -Dtest="data/syriac/devtest.txt" -Doutfile="out/independentTest3.txt"

Running insert script

./insert.pl monolithic models/independent.model out/independentTest3.txt

Gnuplot segmentation graphs

plot './mft_baseline_greedy_unk_lc.txt' u 1:2 w lines, './mft_baseline_greedy_unk_lc.txt' u 1:3  w lines, './mft_baseline_greedy_unk_lc.txt' u 1:4 w lines, './mft_baseline_lc.txt' u 1:2 w lines, './mft_baseline_lc.txt' u 1:3 w lines, './mft_baseline_lc.txt' u 1:4 w lines, './comb_lc.txt' u 1:2 w lines, './comb_lc.txt' u 1:3 w lines, './comb_lc.txt' u 1:4 w lines, './charOnly_lc.txt' u 1:2 w lines, './charOnly_lc.txt' u 1:3 w lines, './charOnly_lc.txt' u 1:4 w lines

Linkage graphs

plot './mftbl_no_unk_lc.txt' u 1:2 w lp, './mftbl_no_unk_lc.txt' u 1:3 w lp, './mftbl_no_unk_lc.txt' u 1:4 w lp, './mftbl_greedy_unk_2_lc.txt' u 1:2 w lp, './mftbl_greedy_unk_2_lc.txt' u 1:4 w lp, './mftbl_greedy_unk_2_lc.txt' u 1:5 w lp, './comb_maxent_wl_lc_train_rare.txt' u 1:2 w lp, './comb_maxent_wl_lc_train_rare.txt' u 1:3 w lp, './comb_maxent_wl_lc_train_rare.txt' u 1:4 w lp, './comb_maxent_wl_train_all_lc.txt' u 1:2 w lp, './comb_maxent_wl_train_all_lc.txt' u 1:3 w lp, './comb_maxent_wl_train_all_lc.txt' u 1:4 w lp, './comb_maxent_wl_train_all_2_lc.txt' u 1:2 w lp, './comb_maxent_wl_train_all_2_lc.txt' u 1:4 w lp, './comb_maxent_wl_train_all_2_lc.txt' u 1:5 w lp