FHMM.xml

Perplexity:

Rev: 255 
Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
Author: rah67 
Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
Seed: 21

Model pipeline
-------------------------------------------
Training...done! (5.886 sec(s))
Running evaluation Tag Accuracy...done! (11.698 sec(s))
Tag Accuracy:
	Tag Accuracy	Unkown Accuracy	Sentence Accuracy	Decoder Suboptimalities Detected
Joint	0.8750238140598209	0.18879855465221318	0.16461366181410975	204
Sub1	0.937083253953134	0.19060523938572718	0.3258678611422172	0
Sub2	0.9156029719946657	NaN	0.3292273236282195	0




Model FHMMBaseline
-------------------------------------------
Training...done! (3.011 sec(s))
Running evaluation Tag Accuracy...done! (52.049 sec(s))
Tag Accuracy:
	Tag Accuracy	Unkown Accuracy	Sentence Accuracy	Decoder Suboptimalities Detected
Joint	0.866260240045723	0.17163504968383017	0.14893617021276595	36
Sub1	0.9347494760906839	0.25203252032520324	0.3169092945128779	0
Sub2	0.900361973709278	NaN	0.2564389697648376	0




Model FHMM-T
-------------------------------------------
Training...done! (3.471 sec(s))
Running evaluation Tag Accuracy...done! (47.417 sec(s))
Tag Accuracy:
	Tag Accuracy	Unkown Accuracy	Sentence Accuracy	Decoder Suboptimalities Detected
Joint	0.8727376643170127	0.1978319783197832	0.17581187010078386	35
Sub1	0.9334635168603543	0.24209575429087624	0.3191489361702128	0
Sub2	0.9102686225947799	NaN	0.3135498320268757	0




Model FHMM-C
-------------------------------------------
Training...done! (3.358 sec(s))
Running evaluation Tag Accuracy...done! (51.886 sec(s))
Tag Accuracy:
	Tag Accuracy	Unkown Accuracy	Sentence Accuracy	Decoder Suboptimalities Detected
Joint	0.885502000381025	0.14543812104787715	0.2038073908174692	26
Sub1	0.933558773099638	0.17344173441734417	0.3124300111982083	0
Sub2	0.932701466946085	NaN	0.4132138857782755	0




Model FHMM-CT
-------------------------------------------
Training...done! (3.626 sec(s))
Running evaluation Tag Accuracy...done! (41.852 sec(s))
Tag Accuracy:
	Tag Accuracy	Unkown Accuracy	Sentence Accuracy	Decoder Suboptimalities Detected
Joint	0.886073537816727	0.17434507678410116	0.21836506159014557	36
Sub1	0.935035244808535	0.2041553748870822	0.3337066069428891	0
Sub2	0.932129929510383	NaN	0.43001119820828665	0




Total Time: 3.74195 min(s)

MEFHMM.xml

Perplexity:

Rev: 255 
Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
Author: rah67 
Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
Seed: 21

Model HMM-MEMM
-------------------------------------------
Training...Dec 18, 2008 4:49:59 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: Original number of features: 108
Dec 18, 2008 4:49:59 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: After selection: 107
Dec 18, 2008 4:51:33 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: Original number of features: 2212
Dec 18, 2008 4:51:33 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: After selection: 1008
done! (2.95935 min(s))
Running evaluation Tag Accuracy...done! (1.0608666666666666 min(s))
Tag Accuracy:
	Tag Accuracy	Unkown Accuracy	Sentence Accuracy	Decoder Suboptimalities Detected
Joint	0.8933130120022862	0.18879855465221318	0.21500559910414332	33
Sub1	0.937083253953134	0.19060523938572718	0.3258678611422172	0
Sub2	0.9350828729281768	NaN	0.458006718924972	0




Model MEMM-HMM
-------------------------------------------
Training...Dec 18, 2008 4:53:54 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: Original number of features: 36757
Dec 18, 2008 4:53:54 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: After selection: 10636
Dec 18, 2008 4:54:18 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: Original number of features: 96754
Dec 18, 2008 4:54:18 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: After selection: 3121
done! (6.807266666666667 min(s))
Running evaluation Tag Accuracy...done! (26.853 sec(s))
Tag Accuracy:
	Tag Accuracy	Unkown Accuracy	Sentence Accuracy	Decoder Suboptimalities Detected
Joint	0.9188893122499524	0.8410117434507678	0.3202687569988802	46
Sub1	0.9668508287292817	0.8943089430894309	0.5027995520716685	0
Sub2	0.9388454943798819	NaN	0.47704367301231804	0




Model MEMM-MEMM
-------------------------------------------
Training...Dec 18, 2008 5:01:09 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: Original number of features: 36757
Dec 18, 2008 5:01:09 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: After selection: 10636
Dec 18, 2008 5:01:31 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: Original number of features: 96754
Dec 18, 2008 5:01:31 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: After selection: 3121
Dec 18, 2008 5:07:55 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: Original number of features: 108
Dec 18, 2008 5:07:55 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: After selection: 107
Dec 18, 2008 5:09:28 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: Original number of features: 2212
Dec 18, 2008 5:09:28 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: After selection: 1008
done! (9.649383333333333 min(s))
Running evaluation Tag Accuracy...done! (1.6488833333333333 min(s))
Tag Accuracy:
	Tag Accuracy	Unkown Accuracy	Sentence Accuracy	Decoder Suboptimalities Detected
Joint	0.9239855210516289	0.8410117434507678	0.3292273236282195	16
Sub1	0.9668508287292817	0.8943089430894309	0.5027995520716685	0
Sub2	0.9439417031815583	NaN	0.48376259798432253	0




Total Time: 22.581583333333334 min(s)

MEMMNPBaseline.xml

Perplexity:

Rev: 255 
Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
Author: rah67 
Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
Seed: 21

Model MEMM-NP
-------------------------------------------
Training...Dec 18, 2008 4:56:06 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: Original number of features: 108
Dec 18, 2008 4:56:06 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: After selection: 107
Dec 18, 2008 4:56:08 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: Original number of features: 18
Dec 18, 2008 4:56:08 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: After selection: 0
done! (43.051 sec(s))
Running evaluation Tag Accuracy...done! (4.628 sec(s))
Tag Accuracy: 0.9598494951419317 (Unknown Accuracy: NaN), Sentence Accuracy: 0.5061590145576708 Decoder Suboptimalities Detected: 0


Total Time: 48.189 sec(s)

memmtester.xml

Perplexity:

Rev: 255 
Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
Author: rah67 
Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
Seed: 20

Model MEMM
-------------------------------------------
Training...Dec 18, 2008 5:05:41 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: Original number of features: 39974
Dec 18, 2008 5:05:41 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: After selection: 11924
Dec 18, 2008 5:06:13 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: Original number of features: 100604
Dec 18, 2008 5:06:13 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
INFO: After selection: 3302
done! (16.579083333333333 min(s))
Running evaluation Tag Accuracy...done! (1.5511333333333333 min(s))
Tag Accuracy:
	Tag Accuracy	Unkown Accuracy	Sentence Accuracy	Decoder Suboptimalities Detected
Joint	0.937986786837495	0.8555420956995761	0.3628230616302187	0
Sub1	0.9595162209510945	0.8706844336765597	0.4711729622266402	0
Sub2	0.9654684762648542	0.9560872198667474	0.5670974155069582	0




Total Time: 18.13906666666667 min(s)

NPBaseline.xml

Perplexity:

Rev: 255 
Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
Author: rah67 
Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
Seed: 21

Model modelG
-------------------------------------------
Training...done! (3.809 sec(s))
Running evaluation Tag Accuracy...done! (1.036 sec(s))
Tag Accuracy: 0.949047005931148 (Unknown Accuracy: NaN), Sentence Accuracy: 0.3717693836978131 Decoder Suboptimalities Detected: 0


Total Time: 5.282 sec(s)

POSBaseline.xml

Perplexity:

Rev: 255 
Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
Author: rah67 
Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
Seed: 21

Model StopStateModel
-------------------------------------------
Training...done! (3.371 sec(s))
Running evaluation Tag Accuracy...done! (2.1365666666666665 min(s))
Tag Accuracy: 0.9269476750321887 (Unknown Accuracy: 0.2271350696547547), Sentence Accuracy: 0.26938369781312127 Decoder Suboptimalities Detected: 0


Model LastTransitionModel
-------------------------------------------
Training...done! (1.016 sec(s))
Running evaluation Tag Accuracy...done! (2.6136 min(s))
Tag Accuracy: 0.9257656668847754 (Unknown Accuracy: 0.20835857056329496), Sentence Accuracy: 0.26192842942345923 Decoder Suboptimalities Detected: 0


Total Time: 4.830183333333333 min(s)

SFHMM.xml

Perplexity:

Rev: 255 
Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
Author: rah67 
Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
Seed: 21

Model SFHMMV100
-------------------------------------------
Training...done! (6.838 sec(s))
Running evaluation Tag Accuracy...done! (9.329 sec(s))
Tag Accuracy:
	Tag Accuracy	Unkown Accuracy	Sentence Accuracy	Decoder Suboptimalities Detected
Joint	0.8588778815012383	0.16440831074977416	0.1769316909294513	358
Sub1	0.9179367498571156	0.17886178861788618	0.2620380739081747	0
Sub2	0.9029338921699371	NaN	0.3146696528555431	0




Model FHMM-CTV100
-------------------------------------------
Training...done! (4.327 sec(s))
Running evaluation Tag Accuracy...done! (7.826 sec(s))
Tag Accuracy:
	Tag Accuracy	Unkown Accuracy	Sentence Accuracy	Decoder Suboptimalities Detected
Joint	0.8602114688512098	0.17253839205058719	0.1791713325867861	368
Sub1	0.9176509811392646	0.1878952122854562	0.2620380739081747	0
Sub2	0.9070775385787769	NaN	0.3381858902575588	0




Total Time: 28.667 sec(s)
nlp-private/jointseqreg.txt · Last modified: 2015/04/22 21:07 by ryancha
Back to top
CC Attribution-Share Alike 4.0 International
chimeric.de = chi`s home Valid CSS Driven by DokuWiki do yourself a favour and use a real browser - get firefox!! Recent changes RSS feed Valid XHTML 1.0