search
Table of Contents
FHMM.xml
Perplexity:
Rev: 255 Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) Author: rah67 Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 Seed: 21 Model pipeline ------------------------------------------- Training...done! (5.886 sec(s)) Running evaluation Tag Accuracy...done! (11.698 sec(s)) Tag Accuracy: Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected Joint 0.8750238140598209 0.18879855465221318 0.16461366181410975 204 Sub1 0.937083253953134 0.19060523938572718 0.3258678611422172 0 Sub2 0.9156029719946657 NaN 0.3292273236282195 0 Model FHMMBaseline ------------------------------------------- Training...done! (3.011 sec(s)) Running evaluation Tag Accuracy...done! (52.049 sec(s)) Tag Accuracy: Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected Joint 0.866260240045723 0.17163504968383017 0.14893617021276595 36 Sub1 0.9347494760906839 0.25203252032520324 0.3169092945128779 0 Sub2 0.900361973709278 NaN 0.2564389697648376 0 Model FHMM-T ------------------------------------------- Training...done! (3.471 sec(s)) Running evaluation Tag Accuracy...done! (47.417 sec(s)) Tag Accuracy: Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected Joint 0.8727376643170127 0.1978319783197832 0.17581187010078386 35 Sub1 0.9334635168603543 0.24209575429087624 0.3191489361702128 0 Sub2 0.9102686225947799 NaN 0.3135498320268757 0 Model FHMM-C ------------------------------------------- Training...done! (3.358 sec(s)) Running evaluation Tag Accuracy...done! (51.886 sec(s)) Tag Accuracy: Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected Joint 0.885502000381025 0.14543812104787715 0.2038073908174692 26 Sub1 0.933558773099638 0.17344173441734417 0.3124300111982083 0 Sub2 0.932701466946085 NaN 0.4132138857782755 0 Model FHMM-CT ------------------------------------------- Training...done! (3.626 sec(s)) Running evaluation Tag Accuracy...done! (41.852 sec(s)) Tag Accuracy: Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected Joint 0.886073537816727 0.17434507678410116 0.21836506159014557 36 Sub1 0.935035244808535 0.2041553748870822 0.3337066069428891 0 Sub2 0.932129929510383 NaN 0.43001119820828665 0 Total Time: 3.74195 min(s)
MEFHMM.xml
Perplexity:
Rev: 255 Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) Author: rah67 Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 Seed: 21 Model HMM-MEMM ------------------------------------------- Training...Dec 18, 2008 4:49:59 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: Original number of features: 108 Dec 18, 2008 4:49:59 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: After selection: 107 Dec 18, 2008 4:51:33 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: Original number of features: 2212 Dec 18, 2008 4:51:33 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: After selection: 1008 done! (2.95935 min(s)) Running evaluation Tag Accuracy...done! (1.0608666666666666 min(s)) Tag Accuracy: Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected Joint 0.8933130120022862 0.18879855465221318 0.21500559910414332 33 Sub1 0.937083253953134 0.19060523938572718 0.3258678611422172 0 Sub2 0.9350828729281768 NaN 0.458006718924972 0 Model MEMM-HMM ------------------------------------------- Training...Dec 18, 2008 4:53:54 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: Original number of features: 36757 Dec 18, 2008 4:53:54 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: After selection: 10636 Dec 18, 2008 4:54:18 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: Original number of features: 96754 Dec 18, 2008 4:54:18 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: After selection: 3121 done! (6.807266666666667 min(s)) Running evaluation Tag Accuracy...done! (26.853 sec(s)) Tag Accuracy: Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected Joint 0.9188893122499524 0.8410117434507678 0.3202687569988802 46 Sub1 0.9668508287292817 0.8943089430894309 0.5027995520716685 0 Sub2 0.9388454943798819 NaN 0.47704367301231804 0 Model MEMM-MEMM ------------------------------------------- Training...Dec 18, 2008 5:01:09 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: Original number of features: 36757 Dec 18, 2008 5:01:09 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: After selection: 10636 Dec 18, 2008 5:01:31 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: Original number of features: 96754 Dec 18, 2008 5:01:31 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: After selection: 3121 Dec 18, 2008 5:07:55 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: Original number of features: 108 Dec 18, 2008 5:07:55 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: After selection: 107 Dec 18, 2008 5:09:28 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: Original number of features: 2212 Dec 18, 2008 5:09:28 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: After selection: 1008 done! (9.649383333333333 min(s)) Running evaluation Tag Accuracy...done! (1.6488833333333333 min(s)) Tag Accuracy: Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected Joint 0.9239855210516289 0.8410117434507678 0.3292273236282195 16 Sub1 0.9668508287292817 0.8943089430894309 0.5027995520716685 0 Sub2 0.9439417031815583 NaN 0.48376259798432253 0 Total Time: 22.581583333333334 min(s)
MEMMNPBaseline.xml
Perplexity:
Rev: 255 Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) Author: rah67 Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 Seed: 21 Model MEMM-NP ------------------------------------------- Training...Dec 18, 2008 4:56:06 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: Original number of features: 108 Dec 18, 2008 4:56:06 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: After selection: 107 Dec 18, 2008 4:56:08 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: Original number of features: 18 Dec 18, 2008 4:56:08 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: After selection: 0 done! (43.051 sec(s)) Running evaluation Tag Accuracy...done! (4.628 sec(s)) Tag Accuracy: 0.9598494951419317 (Unknown Accuracy: NaN), Sentence Accuracy: 0.5061590145576708 Decoder Suboptimalities Detected: 0 Total Time: 48.189 sec(s)
memmtester.xml
Perplexity:
Rev: 255 Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) Author: rah67 Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 Seed: 20 Model MEMM ------------------------------------------- Training...Dec 18, 2008 5:05:41 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: Original number of features: 39974 Dec 18, 2008 5:05:41 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: After selection: 11924 Dec 18, 2008 5:06:13 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: Original number of features: 100604 Dec 18, 2008 5:06:13 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures INFO: After selection: 3302 done! (16.579083333333333 min(s)) Running evaluation Tag Accuracy...done! (1.5511333333333333 min(s)) Tag Accuracy: Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected Joint 0.937986786837495 0.8555420956995761 0.3628230616302187 0 Sub1 0.9595162209510945 0.8706844336765597 0.4711729622266402 0 Sub2 0.9654684762648542 0.9560872198667474 0.5670974155069582 0 Total Time: 18.13906666666667 min(s)
NPBaseline.xml
Perplexity:
Rev: 255 Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) Author: rah67 Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 Seed: 21 Model modelG ------------------------------------------- Training...done! (3.809 sec(s)) Running evaluation Tag Accuracy...done! (1.036 sec(s)) Tag Accuracy: 0.949047005931148 (Unknown Accuracy: NaN), Sentence Accuracy: 0.3717693836978131 Decoder Suboptimalities Detected: 0 Total Time: 5.282 sec(s)
POSBaseline.xml
Perplexity:
Rev: 255 Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) Author: rah67 Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 Seed: 21 Model StopStateModel ------------------------------------------- Training...done! (3.371 sec(s)) Running evaluation Tag Accuracy...done! (2.1365666666666665 min(s)) Tag Accuracy: 0.9269476750321887 (Unknown Accuracy: 0.2271350696547547), Sentence Accuracy: 0.26938369781312127 Decoder Suboptimalities Detected: 0 Model LastTransitionModel ------------------------------------------- Training...done! (1.016 sec(s)) Running evaluation Tag Accuracy...done! (2.6136 min(s)) Tag Accuracy: 0.9257656668847754 (Unknown Accuracy: 0.20835857056329496), Sentence Accuracy: 0.26192842942345923 Decoder Suboptimalities Detected: 0 Total Time: 4.830183333333333 min(s)
SFHMM.xml
Perplexity:
Rev: 255 Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) Author: rah67 Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 Seed: 21 Model SFHMMV100 ------------------------------------------- Training...done! (6.838 sec(s)) Running evaluation Tag Accuracy...done! (9.329 sec(s)) Tag Accuracy: Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected Joint 0.8588778815012383 0.16440831074977416 0.1769316909294513 358 Sub1 0.9179367498571156 0.17886178861788618 0.2620380739081747 0 Sub2 0.9029338921699371 NaN 0.3146696528555431 0 Model FHMM-CTV100 ------------------------------------------- Training...done! (4.327 sec(s)) Running evaluation Tag Accuracy...done! (7.826 sec(s)) Tag Accuracy: Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected Joint 0.8602114688512098 0.17253839205058719 0.1791713325867861 368 Sub1 0.9176509811392646 0.1878952122854562 0.2620380739081747 0 Sub2 0.9070775385787769 NaN 0.3381858902575588 0 Total Time: 28.667 sec(s)
