Differences

This shows you the differences between two versions of the page.

Link to this comparison view

nlp-private:jointseqreg [2015/04/22 21:07] (current)
ryancha created
Line 1: Line 1:
 +== FHMM.xml ==
 +Perplexity:
 +<pre>
 +Rev: 255 
 +Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
 +Author: rah67 
 +Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
 +Seed: 21
 +
 +Model pipeline
 +-------------------------------------------
 +Training...done! (5.886 sec(s))
 +Running evaluation Tag Accuracy...done! (11.698 sec(s))
 +Tag Accuracy:
 + Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected
 +Joint 0.8750238140598209 0.18879855465221318 0.16461366181410975 204
 +Sub1 0.937083253953134 0.19060523938572718 0.3258678611422172 0
 +Sub2 0.9156029719946657 NaN 0.3292273236282195 0
 +
 +
 +
 +
 +Model FHMMBaseline
 +-------------------------------------------
 +Training...done! (3.011 sec(s))
 +Running evaluation Tag Accuracy...done! (52.049 sec(s))
 +Tag Accuracy:
 + Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected
 +Joint 0.866260240045723 0.17163504968383017 0.14893617021276595 36
 +Sub1 0.9347494760906839 0.25203252032520324 0.3169092945128779 0
 +Sub2 0.900361973709278 NaN 0.2564389697648376 0
 +
 +
 +
 +
 +Model FHMM-T
 +-------------------------------------------
 +Training...done! (3.471 sec(s))
 +Running evaluation Tag Accuracy...done! (47.417 sec(s))
 +Tag Accuracy:
 + Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected
 +Joint 0.8727376643170127 0.1978319783197832 0.17581187010078386 35
 +Sub1 0.9334635168603543 0.24209575429087624 0.3191489361702128 0
 +Sub2 0.9102686225947799 NaN 0.3135498320268757 0
 +
 +
 +
 +
 +Model FHMM-C
 +-------------------------------------------
 +Training...done! (3.358 sec(s))
 +Running evaluation Tag Accuracy...done! (51.886 sec(s))
 +Tag Accuracy:
 + Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected
 +Joint 0.885502000381025 0.14543812104787715 0.2038073908174692 26
 +Sub1 0.933558773099638 0.17344173441734417 0.3124300111982083 0
 +Sub2 0.932701466946085 NaN 0.4132138857782755 0
 +
 +
 +
 +
 +Model FHMM-CT
 +-------------------------------------------
 +Training...done! (3.626 sec(s))
 +Running evaluation Tag Accuracy...done! (41.852 sec(s))
 +Tag Accuracy:
 + Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected
 +Joint 0.886073537816727 0.17434507678410116 0.21836506159014557 36
 +Sub1 0.935035244808535 0.2041553748870822 0.3337066069428891 0
 +Sub2 0.932129929510383 NaN 0.43001119820828665 0
 +
 +
 +
 +
 +Total Time: 3.74195 min(s)
 +</​pre>​
 +
 +
 +== MEFHMM.xml ==
 +Perplexity:
 +<pre>
 +Rev: 255 
 +Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
 +Author: rah67 
 +Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
 +Seed: 21
 +
 +Model HMM-MEMM
 +-------------------------------------------
 +Training...Dec 18, 2008 4:49:59 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: Original number of features: 108
 +Dec 18, 2008 4:49:59 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: After selection: 107
 +Dec 18, 2008 4:51:33 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: Original number of features: 2212
 +Dec 18, 2008 4:51:33 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: After selection: 1008
 +done! (2.95935 min(s))
 +Running evaluation Tag Accuracy...done! (1.0608666666666666 min(s))
 +Tag Accuracy:
 + Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected
 +Joint 0.8933130120022862 0.18879855465221318 0.21500559910414332 33
 +Sub1 0.937083253953134 0.19060523938572718 0.3258678611422172 0
 +Sub2 0.9350828729281768 NaN 0.458006718924972 0
 +
 +
 +
 +
 +Model MEMM-HMM
 +-------------------------------------------
 +Training...Dec 18, 2008 4:53:54 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: Original number of features: 36757
 +Dec 18, 2008 4:53:54 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: After selection: 10636
 +Dec 18, 2008 4:54:18 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: Original number of features: 96754
 +Dec 18, 2008 4:54:18 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: After selection: 3121
 +done! (6.807266666666667 min(s))
 +Running evaluation Tag Accuracy...done! (26.853 sec(s))
 +Tag Accuracy:
 + Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected
 +Joint 0.9188893122499524 0.8410117434507678 0.3202687569988802 46
 +Sub1 0.9668508287292817 0.8943089430894309 0.5027995520716685 0
 +Sub2 0.9388454943798819 NaN 0.47704367301231804 0
 +
 +
 +
 +
 +Model MEMM-MEMM
 +-------------------------------------------
 +Training...Dec 18, 2008 5:01:09 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: Original number of features: 36757
 +Dec 18, 2008 5:01:09 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: After selection: 10636
 +Dec 18, 2008 5:01:31 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: Original number of features: 96754
 +Dec 18, 2008 5:01:31 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: After selection: 3121
 +Dec 18, 2008 5:07:55 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: Original number of features: 108
 +Dec 18, 2008 5:07:55 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: After selection: 107
 +Dec 18, 2008 5:09:28 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: Original number of features: 2212
 +Dec 18, 2008 5:09:28 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: After selection: 1008
 +done! (9.649383333333333 min(s))
 +Running evaluation Tag Accuracy...done! (1.6488833333333333 min(s))
 +Tag Accuracy:
 + Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected
 +Joint 0.9239855210516289 0.8410117434507678 0.3292273236282195 16
 +Sub1 0.9668508287292817 0.8943089430894309 0.5027995520716685 0
 +Sub2 0.9439417031815583 NaN 0.48376259798432253 0
 +
 +
 +
 +
 +Total Time: 22.581583333333334 min(s)
 +</​pre>​
 +
 +== MEMMNPBaseline.xml ==
 +Perplexity:
 +<pre>
 +Rev: 255 
 +Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
 +Author: rah67 
 +Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
 +Seed: 21
 +
 +Model MEMM-NP
 +-------------------------------------------
 +Training...Dec 18, 2008 4:56:06 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: Original number of features: 108
 +Dec 18, 2008 4:56:06 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: After selection: 107
 +Dec 18, 2008 4:56:08 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: Original number of features: 18
 +Dec 18, 2008 4:56:08 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: After selection: 0
 +done! (43.051 sec(s))
 +Running evaluation Tag Accuracy...done! (4.628 sec(s))
 +Tag Accuracy: 0.9598494951419317 (Unknown Accuracy: NaN), Sentence Accuracy: 0.5061590145576708 Decoder Suboptimalities Detected: 0
 +
 +
 +Total Time: 48.189 sec(s)
 +</​pre>​
 +
 +
 +== memmtester.xml ==
 +Perplexity:
 +<pre>
 +Rev: 255 
 +Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
 +Author: rah67 
 +Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
 +Seed: 20
 +
 +Model MEMM
 +-------------------------------------------
 +Training...Dec 18, 2008 5:05:41 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: Original number of features: 39974
 +Dec 18, 2008 5:05:41 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: After selection: 11924
 +Dec 18, 2008 5:06:13 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: Original number of features: 100604
 +Dec 18, 2008 5:06:13 PM edu.byu.nlp.features.selectors.CountCutoff selectFeatures
 +INFO: After selection: 3302
 +done! (16.579083333333333 min(s))
 +Running evaluation Tag Accuracy...done! (1.5511333333333333 min(s))
 +Tag Accuracy:
 + Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected
 +Joint 0.937986786837495 0.8555420956995761 0.3628230616302187 0
 +Sub1 0.9595162209510945 0.8706844336765597 0.4711729622266402 0
 +Sub2 0.9654684762648542 0.9560872198667474 0.5670974155069582 0
 +
 +
 +
 +
 +Total Time: 18.13906666666667 min(s)
 +</​pre>​
 +
 +== NPBaseline.xml ==
 +Perplexity:
 +<pre>
 +Rev: 255 
 +Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
 +Author: rah67 
 +Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
 +Seed: 21
 +
 +Model modelG
 +-------------------------------------------
 +Training...done! (3.809 sec(s))
 +Running evaluation Tag Accuracy...done! (1.036 sec(s))
 +Tag Accuracy: 0.949047005931148 (Unknown Accuracy: NaN), Sentence Accuracy: 0.3717693836978131 Decoder Suboptimalities Detected: 0
 +
 +
 +Total Time: 5.282 sec(s)
 +</​pre>​
 +
 +== POSBaseline.xml ==
 +Perplexity:
 +<pre>
 +Rev: 255 
 +Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
 +Author: rah67 
 +Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
 +Seed: 21
 +
 +Model StopStateModel
 +-------------------------------------------
 +Training...done! (3.371 sec(s))
 +Running evaluation Tag Accuracy...done! (2.1365666666666665 min(s))
 +Tag Accuracy: 0.9269476750321887 (Unknown Accuracy: 0.2271350696547547),​ Sentence Accuracy: 0.26938369781312127 Decoder Suboptimalities Detected: 0
 +
 +
 +Model LastTransitionModel
 +-------------------------------------------
 +Training...done! (1.016 sec(s))
 +Running evaluation Tag Accuracy...done! (2.6136 min(s))
 +Tag Accuracy: 0.9257656668847754 (Unknown Accuracy: 0.20835857056329496),​ Sentence Accuracy: 0.26192842942345923 Decoder Suboptimalities Detected: 0
 +
 +
 +Total Time: 4.830183333333333 min(s)
 +</​pre>​
 +
 +
 +== SFHMM.xml ==
 +Perplexity:
 +<pre>
 +Rev: 255 
 +Date: 2008-10-22 21:55:23 -0600 (Wed, 22 Oct 2008) 
 +Author: rah67 
 +Id: ExperimentHarness.java 255 2008-10-23 03:55:23Z rah67 
 +Seed: 21
 +
 +Model SFHMMV100
 +-------------------------------------------
 +Training...done! (6.838 sec(s))
 +Running evaluation Tag Accuracy...done! (9.329 sec(s))
 +Tag Accuracy:
 + Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected
 +Joint 0.8588778815012383 0.16440831074977416 0.1769316909294513 358
 +Sub1 0.9179367498571156 0.17886178861788618 0.2620380739081747 0
 +Sub2 0.9029338921699371 NaN 0.3146696528555431 0
 +
 +
 +
 +
 +Model FHMM-CTV100
 +-------------------------------------------
 +Training...done! (4.327 sec(s))
 +Running evaluation Tag Accuracy...done! (7.826 sec(s))
 +Tag Accuracy:
 + Tag Accuracy Unkown Accuracy Sentence Accuracy Decoder Suboptimalities Detected
 +Joint 0.8602114688512098 0.17253839205058719 0.1791713325867861 368
 +Sub1 0.9176509811392646 0.1878952122854562 0.2620380739081747 0
 +Sub2 0.9070775385787769 NaN 0.3381858902575588 0
 +
 +
 +
 +
 +Total Time: 28.667 sec(s)
 +</​pre>​
  
nlp-private/jointseqreg.txt ยท Last modified: 2015/04/22 21:07 by ryancha
Back to top
CC Attribution-Share Alike 4.0 International
chimeric.de = chi`s home Valid CSS Driven by DokuWiki do yourself a favour and use a real browser - get firefox!! Recent changes RSS feed Valid XHTML 1.0