Status: Done!
Total Time
21m27s
Max Memory Usage
444M
Domain:
SequenceTagging
Learn time
Train acc.
1.000
Train F1
0.997
Predict train time
Test acc.
0.952
Test F1
0.777
Predict test time
Log file
===== MAIN: learn based on training data =====
=== START program1: ./run learn ../dataset2/train
CRF++: Yet Another CRF Tool Kit
Copyright (C) 2005-2009 Taku Kudo, All rights reserved.
reading training data: 100.. 200.. 300.. 400.. 500.. 600.. 700.. 800.. 900.. 1000.. 1100.. 1200.. 1300.. 1400.. 1500.. 1600.. 1700.. 1800.. 1900.. 2000.. 2100.. 2200.. 2300.. 2400.. 2500.. 2600.. 2700.. 2800.. 2900.. 3000.. 3100.. 3200.. 3300.. 3400.. 3500.. 3600.. 3700.. 3800.. 3900.. 4000.. 4100.. 4200.. 4300.. 4400.. 4500.. 4600.. 4700.. 4800.. 4900.. 5000.. 5100.. 5200.. 5300.. 5400.. 5500.. 5600.. 5700.. 5800.. 5900.. 6000.. 6100.. 6200.. 6300.. 6400.. 6500.. 6600.. 6700.. 6800.. 6900.. 7000.. 7100.. 7200.. 7300.. 7400.. 7500.. 7600.. 7700.. 7800.. 7900.. 8000.. 8100.. 8200.. 8300.. 8400.. 8500.. 8600.. 8700.. 8800.. 8900.. 9000.. 9100.. 9200.. 9300.. 9400.. 9500.. 9600.. 9700.. 9800.. 9900.. 10000.. 10100.. 10200.. 10300.. 10400.. 10500.. 10600.. 10700.. 10800.. 10900.. 11000.. 11100.. 11200.. 11300.. 11400.. 11500.. 11600.. 11700.. 11800.. 11900.. 12000.. 12100.. 12200.. 12300.. 12400.. 12500.. 12600.. 12700.. 12800.. 12900.. 13000.. 13100.. 13200.. 13300.. 13400.. 13500.. 13600.. 13700.. 13800.. 13900.. 14000.. 14100.. 14200.. 14300.. 14400.. 14500.. 14600.. 14700.. 14800.. 14900..
Done!6.90 s
Number of sentences: 14987
Number of features: 3202614
Number of thread(s): 1
Freq: 1
eta: 0.00010
C: 1.00000
shrinking size: 20
iter=0 terr=0.96510 serr=0.99900 act=3202614 obj=449479.64011 diff=1.00000
iter=1 terr=0.16641 serr=0.74278 act=3202614 obj=281495.96091 diff=0.37373
iter=2 terr=0.16641 serr=0.74278 act=3202614 obj=484150.17575 diff=0.71992
iter=3 terr=0.16641 serr=0.74278 act=3202614 obj=182716.72763 diff=0.62260
iter=4 terr=0.16641 serr=0.74278 act=3202614 obj=141695.13835 diff=0.22451
iter=5 terr=0.18255 serr=0.74978 act=3202614 obj=260763.81592 diff=0.84032
iter=6 terr=0.16404 serr=0.74284 act=3202614 obj=112092.62895 diff=0.57014
iter=7 terr=0.15182 serr=0.73650 act=3202614 obj=102056.13575 diff=0.08954
iter=8 terr=0.12044 serr=0.64583 act=3202614 obj=76623.31988 diff=0.24920
iter=9 terr=0.11126 serr=0.60946 act=3202614 obj=68088.87759 diff=0.11138
iter=10 terr=0.10630 serr=0.56796 act=3202614 obj=60673.71413 diff=0.10890
iter=11 terr=0.09583 serr=0.53520 act=3202614 obj=53164.70215 diff=0.12376
iter=12 terr=0.09098 serr=0.51698 act=3202614 obj=49262.52728 diff=0.07340
iter=13 terr=0.09144 serr=0.50804 act=3202614 obj=48691.10150 diff=0.01160
iter=14 terr=0.08514 serr=0.48295 act=3202614 obj=44914.26308 diff=0.07757
iter=15 terr=0.08251 serr=0.47041 act=3202614 obj=43912.96665 diff=0.02229
iter=16 terr=0.08055 serr=0.46073 act=3202614 obj=42385.94235 diff=0.03477
iter=17 terr=0.07654 serr=0.44212 act=3202614 obj=40331.09907 diff=0.04848
iter=18 terr=0.08706 serr=0.46487 act=3202614 obj=39693.02640 diff=0.01582
iter=19 terr=0.07331 serr=0.43037 act=3202614 obj=37417.77147 diff=0.05732
iter=20 terr=0.07096 serr=0.42443 act=3202614 obj=36636.57415 diff=0.02088
iter=21 terr=0.06805 serr=0.41396 act=3202614 obj=35556.96708 diff=0.02947
iter=22 terr=0.06619 serr=0.41356 act=3202614 obj=34342.68205 diff=0.03415
iter=23 terr=0.06394 serr=0.39641 act=3202614 obj=33007.46195 diff=0.03888
iter=24 terr=0.06296 serr=0.39187 act=3202614 obj=32234.99077 diff=0.02340
iter=25 terr=0.05988 serr=0.38046 act=3202614 obj=30514.94483 diff=0.05336
iter=26 terr=0.06241 serr=0.38146 act=3202614 obj=30524.95721 diff=0.00033
iter=27 terr=0.05824 serr=0.36899 act=3202614 obj=29853.20360 diff=0.02201
iter=28 terr=0.05475 serr=0.35958 act=3202614 obj=28881.81156 diff=0.03254
iter=29 terr=0.05118 serr=0.34583 act=3202614 obj=27508.05295 diff=0.04756
iter=30 terr=0.04836 serr=0.33182 act=3202614 obj=26296.64591 diff=0.04404
iter=31 terr=0.04819 serr=0.32982 act=3202614 obj=25218.82007 diff=0.04099
iter=32 terr=0.04587 serr=0.31801 act=3202614 obj=24386.86582 diff=0.03299
iter=33 terr=0.04302 serr=0.30460 act=3202614 obj=23106.25749 diff=0.05251
iter=34 terr=0.04130 serr=0.29419 act=3202614 obj=22299.99479 diff=0.03489
iter=35 terr=0.04145 serr=0.28938 act=3202614 obj=21993.00299 diff=0.01377
iter=36 terr=0.03869 serr=0.28231 act=3202614 obj=21268.57566 diff=0.03294
iter=37 terr=0.03784 serr=0.27891 act=3202614 obj=20902.95880 diff=0.01719
iter=38 terr=0.03621 serr=0.27097 act=3202614 obj=20418.01848 diff=0.02320
iter=39 terr=0.03495 serr=0.26443 act=3202614 obj=19772.51786 diff=0.03161
iter=40 terr=0.03403 serr=0.26436 act=3202614 obj=19818.87605 diff=0.00234
iter=41 terr=0.03300 serr=0.25776 act=3202614 obj=19299.11272 diff=0.02623
iter=42 terr=0.03141 serr=0.24555 act=3202614 obj=18607.53795 diff=0.03583
iter=43 terr=0.03026 serr=0.23794 act=3202614 obj=18207.39380 diff=0.02150
iter=44 terr=0.02896 serr=0.23087 act=3202614 obj=17807.74979 diff=0.02195
iter=45 terr=0.02711 serr=0.21986 act=3202614 obj=17211.27212 diff=0.03350
iter=46 terr=0.02693 serr=0.21725 act=3202614 obj=16942.61900 diff=0.01561
iter=47 terr=0.02443 serr=0.20585 act=3202614 obj=16397.99968 diff=0.03214
iter=48 terr=0.02387 serr=0.20144 act=3202614 obj=16117.49182 diff=0.01711
iter=49 terr=0.02304 serr=0.19283 act=3202614 obj=15777.21618 diff=0.02111
iter=50 terr=0.02179 serr=0.18970 act=3202614 obj=15262.26703 diff=0.03264
iter=51 terr=0.01960 serr=0.17328 act=3202614 obj=14715.21971 diff=0.03584
iter=52 terr=0.01863 serr=0.16781 act=3202614 obj=14453.06214 diff=0.01782
iter=53 terr=0.01737 serr=0.15874 act=3202614 obj=14183.70111 diff=0.01864
iter=54 terr=0.01648 serr=0.15253 act=3202614 obj=13878.71556 diff=0.02150
iter=55 terr=0.01474 serr=0.13845 act=3202614 obj=13581.05971 diff=0.02145
iter=56 terr=0.01348 serr=0.12831 act=3202614 obj=13249.28057 diff=0.02443
iter=57 terr=0.01313 serr=0.12538 act=3202614 obj=13060.87981 diff=0.01422
iter=58 terr=0.01224 serr=0.11810 act=3202614 obj=12713.07645 diff=0.02663
iter=59 terr=0.01194 serr=0.11944 act=3202614 obj=12558.60179 diff=0.01215
iter=60 terr=0.01117 serr=0.11276 act=3202614 obj=12277.82547 diff=0.02236
iter=61 terr=0.01099 serr=0.10976 act=3202614 obj=12129.39103 diff=0.01209
iter=62 terr=0.01043 serr=0.10496 act=3202614 obj=11948.92061 diff=0.01488
iter=63 terr=0.01049 serr=0.10849 act=3202614 obj=11703.19432 diff=0.02056
iter=64 terr=0.00936 serr=0.09788 act=3202614 obj=11440.78925 diff=0.02242
iter=65 terr=0.00905 serr=0.09448 act=3202614 obj=11310.84934 diff=0.01136
iter=66 terr=0.00845 serr=0.09014 act=3202614 obj=11154.36469 diff=0.01383
iter=67 terr=0.00828 serr=0.09034 act=3202614 obj=10992.14907 diff=0.01454
iter=68 terr=0.00748 serr=0.08267 act=3202614 obj=10787.82359 diff=0.01859
iter=69 terr=0.00709 serr=0.07807 act=3202614 obj=10619.67873 diff=0.01559
iter=70 terr=0.00675 serr=0.07433 act=3202614 obj=10498.48355 diff=0.01141
iter=71 terr=0.00635 serr=0.07180 act=3202614 obj=10286.79221 diff=0.02016
iter=72 terr=0.00538 serr=0.05985 act=3202614 obj=10151.22353 diff=0.01318
iter=73 terr=0.00548 serr=0.06172 act=3202614 obj=10057.61011 diff=0.00922
iter=74 terr=0.00548 serr=0.06212 act=3202614 obj=9995.63679 diff=0.00616
iter=75 terr=0.00529 serr=0.06045 act=3202614 obj=9903.47025 diff=0.00922
iter=76 terr=0.00586 serr=0.06639 act=3202614 obj=9995.56041 diff=0.00930
iter=77 terr=0.00538 serr=0.06139 act=3202614 obj=9822.65498 diff=0.01730
iter=78 terr=0.00489 serr=0.05585 act=3202614 obj=9681.21864 diff=0.01440
iter=79 terr=0.00454 serr=0.05225 act=3202614 obj=9568.25955 diff=0.01167
iter=80 terr=0.00420 serr=0.04858 act=3202614 obj=9491.07533 diff=0.00807
iter=81 terr=0.00384 serr=0.04491 act=3202614 obj=9412.74185 diff=0.00825
iter=82 terr=0.00330 serr=0.03797 act=3202614 obj=9344.31703 diff=0.00727
iter=83 terr=0.00324 serr=0.03790 act=3202614 obj=9265.68364 diff=0.00842
iter=84 terr=0.00321 serr=0.03717 act=3202614 obj=9205.37101 diff=0.00651
iter=85 terr=0.00310 serr=0.03670 act=3202614 obj=9140.37399 diff=0.00706
iter=86 terr=0.00325 serr=0.03837 act=3202614 obj=9071.45071 diff=0.00754
iter=87 terr=0.00291 serr=0.03490 act=3202614 obj=8998.92949 diff=0.00799
iter=88 terr=0.00281 serr=0.03370 act=3202614 obj=8952.14576 diff=0.00520
iter=89 terr=0.00255 serr=0.03123 act=3202614 obj=8872.57767 diff=0.00889
iter=90 terr=0.00231 serr=0.02889 act=3202614 obj=8808.70514 diff=0.00720
iter=91 terr=0.00226 serr=0.02822 act=3202614 obj=8745.64864 diff=0.00716
iter=92 terr=0.00217 serr=0.02689 act=3202614 obj=8705.92511 diff=0.00454
iter=93 terr=0.00218 serr=0.02702 act=3202614 obj=8661.77268 diff=0.00507
iter=94 terr=0.00203 serr=0.02475 act=3202614 obj=8615.87521 diff=0.00530
iter=95 terr=0.00203 serr=0.02482 act=3202614 obj=8583.05211 diff=0.00381
iter=96 terr=0.00198 serr=0.02435 act=3202614 obj=8547.17410 diff=0.00418
iter=97 terr=0.00195 serr=0.02435 act=3202614 obj=8514.48914 diff=0.00382
iter=98 terr=0.00187 serr=0.02329 act=3202614 obj=8482.90526 diff=0.00371
iter=99 terr=0.00165 serr=0.02042 act=3202614 obj=8418.14795 diff=0.00763
iter=100 terr=0.00134 serr=0.01641 act=3202614 obj=8453.47940 diff=0.00420
iter=101 terr=0.00146 serr=0.01795 act=3202614 obj=8399.33423 diff=0.00641
iter=102 terr=0.00138 serr=0.01715 act=3202614 obj=8380.56909 diff=0.00223
iter=103 terr=0.00128 serr=0.01608 act=3202614 obj=8352.21187 diff=0.00338
iter=104 terr=0.00134 serr=0.01701 act=3202614 obj=8359.22683 diff=0.00084
iter=105 terr=0.00126 serr=0.01608 act=3202614 obj=8332.85569 diff=0.00315
iter=106 terr=0.00115 serr=0.01481 act=3202614 obj=8307.05768 diff=0.00310
iter=107 terr=0.00108 serr=0.01388 act=3202614 obj=8280.04430 diff=0.00325
iter=108 terr=0.00089 serr=0.01161 act=3202614 obj=8259.02952 diff=0.00254
iter=109 terr=0.00088 serr=0.01134 act=3202614 obj=8242.98212 diff=0.00194
iter=110 terr=0.00090 serr=0.01174 act=3202614 obj=8228.55800 diff=0.00175
iter=111 terr=0.00092 serr=0.01201 act=3202614 obj=8215.33802 diff=0.00161
iter=112 terr=0.00087 serr=0.01134 act=3202614 obj=8201.38206 diff=0.00170
iter=113 terr=0.00078 serr=0.01008 act=3202614 obj=8178.47840 diff=0.00279
iter=114 terr=0.00068 serr=0.00881 act=3202614 obj=8165.35782 diff=0.00160
iter=115 terr=0.00068 serr=0.00874 act=3202614 obj=8154.85834 diff=0.00129
iter=116 terr=0.00063 serr=0.00801 act=3202614 obj=8132.43238 diff=0.00275
iter=117 terr=0.00081 serr=0.01061 act=3202614 obj=8163.54103 diff=0.00383
iter=118 terr=0.00066 serr=0.00867 act=3202614 obj=8121.62011 diff=0.00514
iter=119 terr=0.00066 serr=0.00861 act=3202614 obj=8110.23617 diff=0.00140
iter=120 terr=0.00065 serr=0.00861 act=3202614 obj=8098.33000 diff=0.00147
iter=121 terr=0.00057 serr=0.00754 act=3202614 obj=8098.89726 diff=0.00007
iter=122 terr=0.00062 serr=0.00814 act=3202614 obj=8091.38302 diff=0.00093
iter=123 terr=0.00063 serr=0.00834 act=3202614 obj=8083.63838 diff=0.00096
iter=124 terr=0.00062 serr=0.00827 act=3202614 obj=8073.77094 diff=0.00122
iter=125 terr=0.00063 serr=0.00847 act=3202614 obj=8065.17284 diff=0.00106
iter=126 terr=0.00065 serr=0.00854 act=3202614 obj=8057.95919 diff=0.00089
iter=127 terr=0.00062 serr=0.00807 act=3202614 obj=8053.28306 diff=0.00058
iter=128 terr=0.00057 serr=0.00741 act=3202614 obj=8046.42232 diff=0.00085
iter=129 terr=0.00051 serr=0.00667 act=3202614 obj=8043.45121 diff=0.00037
iter=130 terr=0.00051 serr=0.00674 act=3202614 obj=8036.46776 diff=0.00087
iter=131 terr=0.00054 serr=0.00707 act=3202614 obj=8031.09144 diff=0.00067
iter=132 terr=0.00056 serr=0.00741 act=3202614 obj=8028.18392 diff=0.00036
iter=133 terr=0.00057 serr=0.00747 act=3202614 obj=8022.33354 diff=0.00073
iter=134 terr=0.00062 serr=0.00801 act=3202614 obj=8027.78114 diff=0.00068
iter=135 terr=0.00060 serr=0.00774 act=3202614 obj=8018.38745 diff=0.00117
iter=136 terr=0.00058 serr=0.00747 act=3202614 obj=8012.27110 diff=0.00076
iter=137 terr=0.00057 serr=0.00741 act=3202614 obj=8009.23042 diff=0.00038
iter=138 terr=0.00056 serr=0.00734 act=3202614 obj=8005.14337 diff=0.00051
iter=139 terr=0.00052 serr=0.00667 act=3202614 obj=8005.56900 diff=0.00005
iter=140 terr=0.00056 serr=0.00727 act=3202614 obj=8002.75108 diff=0.00035
iter=141 terr=0.00056 serr=0.00721 act=3202614 obj=7999.65006 diff=0.00039
iter=142 terr=0.00057 serr=0.00741 act=3202614 obj=7995.87462 diff=0.00047
iter=143 terr=0.00054 serr=0.00714 act=3202614 obj=7993.17164 diff=0.00034
iter=144 terr=0.00054 serr=0.00714 act=3202614 obj=7989.23444 diff=0.00049
iter=145 terr=0.00054 serr=0.00707 act=3202614 obj=7987.25557 diff=0.00025
iter=146 terr=0.00055 serr=0.00721 act=3202614 obj=7983.99220 diff=0.00041
iter=147 terr=0.00057 serr=0.00741 act=3202614 obj=7982.09704 diff=0.00024
iter=148 terr=0.00057 serr=0.00754 act=3202614 obj=7979.80292 diff=0.00029
iter=149 terr=0.00057 serr=0.00747 act=3202614 obj=7977.17933 diff=0.00033
iter=150 terr=0.00056 serr=0.00734 act=3202614 obj=7975.34049 diff=0.00023
iter=151 terr=0.00053 serr=0.00701 act=3202614 obj=7971.79316 diff=0.00044
iter=152 terr=0.00053 serr=0.00694 act=3202614 obj=7968.55461 diff=0.00041
iter=153 terr=0.00052 serr=0.00681 act=3202614 obj=7966.38573 diff=0.00027
iter=154 terr=0.00054 serr=0.00714 act=3202614 obj=7963.42769 diff=0.00037
iter=155 terr=0.00054 serr=0.00714 act=3202614 obj=7962.45934 diff=0.00012
iter=156 terr=0.00053 serr=0.00694 act=3202614 obj=7961.22228 diff=0.00016
iter=157 terr=0.00055 serr=0.00727 act=3202614 obj=7960.86705 diff=0.00004
iter=158 terr=0.00050 serr=0.00661 act=3202614 obj=7959.23793 diff=0.00020
iter=159 terr=0.00050 serr=0.00661 act=3202614 obj=7958.73744 diff=0.00006
iter=160 terr=0.00050 serr=0.00654 act=3202614 obj=7957.78424 diff=0.00012
iter=161 terr=0.00049 serr=0.00647 act=3202614 obj=7956.48670 diff=0.00016
iter=162 terr=0.00051 serr=0.00667 act=3202614 obj=7956.06372 diff=0.00005
iter=163 terr=0.00051 serr=0.00667 act=3202614 obj=7954.39960 diff=0.00021
iter=164 terr=0.00051 serr=0.00674 act=3202614 obj=7953.88721 diff=0.00006
iter=165 terr=0.00052 serr=0.00681 act=3202614 obj=7953.10765 diff=0.00010
iter=166 terr=0.00049 serr=0.00654 act=3202614 obj=7952.20728 diff=0.00011
iter=167 terr=0.00049 serr=0.00647 act=3202614 obj=7951.26403 diff=0.00012
iter=168 terr=0.00048 serr=0.00634 act=3202614 obj=7950.76599 diff=0.00006
iter=169 terr=0.00049 serr=0.00647 act=3202614 obj=7949.92437 diff=0.00011
iter=170 terr=0.00046 serr=0.00601 act=3202614 obj=7949.03852 diff=0.00011
iter=171 terr=0.00045 serr=0.00594 act=3202614 obj=7948.13145 diff=0.00011
iter=172 terr=0.00044 serr=0.00581 act=3202614 obj=7947.60474 diff=0.00007
iter=173 terr=0.00045 serr=0.00587 act=3202614 obj=7947.29423 diff=0.00004
iter=174 terr=0.00044 serr=0.00581 act=3202614 obj=7946.94202 diff=0.00004
Done!1264.93 s
=== END program1: ./run learn ../dataset2/train --- OK [1276s]
===== MAIN: predict/evaluate on train data =====
=== START program3: ./run stripLabels ../dataset2/train ../program0/evalTrain.in
=== END program3: ./run stripLabels ../dataset2/train ../program0/evalTrain.in --- OK [1s]
=== START program1: ./run predict ../program0/evalTrain.in ../program0/evalTrain.out
=== END program1: ./run predict ../program0/evalTrain.in ../program0/evalTrain.out --- OK [3s]
=== START program4: ./run evaluate ../dataset2/train ../program0/evalTrain.out
=== END program4: ./run evaluate ../dataset2/train ../program0/evalTrain.out --- OK [8s]
===== MAIN: predict/evaluate on test data =====
=== START program3: ./run stripLabels ../dataset2/test ../program0/evalTest.in
=== END program3: ./run stripLabels ../dataset2/test ../program0/evalTest.in --- OK [0s]
=== START program1: ./run predict ../program0/evalTest.in ../program0/evalTest.out
=== END program1: ./run predict ../program0/evalTest.in ../program0/evalTest.out --- OK [1s]
=== START program4: ./run evaluate ../dataset2/test ../program0/evalTest.out
=== END program4: ./run evaluate ../dataset2/test ../program0/evalTest.out --- OK [1s]
real 21m30.844s
user 21m25.224s
sys 0m1.032s
supervised-learning : Main entry for supervised learning for training and testing a program on a dataset.
(learner:Program) crfpp : Yet Another CRF toolkit (http://crfpp.sourceforge.net)
(dataset:Dataset) ner-conll2003-eng : English named-entity recognition from 2003 CoNLL Shared Task.
(stripper:Program[Strip]) sequence-conll-utils : Validates and inspects SequenceTagging (CoNLL Shared Task) datasets.
(evaluator:Program[Evaluate]) sequence-conll-evaluator : Evaluator for SequenceTagging.
doTest:
evaluate:
accuracy: 0.9523
errorRate: 0.2232
f1: 0.7768
precision: 0.795
recall: 0.7594
success: true
time: 1
predict:
strip:
doTrain:
evaluate:
accuracy: 0.9996
errorRate: 0.00280000000000001
f1: 0.9972
precision: 0.9984
recall: 0.996
success: true
time: 8
predict:
strip:
exitCode: 0
learn:
success: true
Comments:
Post comment:
Must be logged in to post comments.