Usage: "run learn trainingFileName" OR "run predict testFileName predictionFileName"
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run learn '/home/mlcomp/worker1/scratch/program0/../dataset2/train'
used (Mb) gc trigger (Mb) max used (Mb)
Ncells 109029 3.0 350000 9.4 350000 9.4
Vcells 2456544 18.8 4948013 37.8 4635526 35.4
used (Mb) gc trigger (Mb) max used (Mb)
Ncells 105741 2.9 350000 9.4 350000 9.4
Vcells 2453437 18.8 3042356 23.3 2453839 18.8
[1] 1
[1] "Svd done!"
[1] "data3 update done!"
[1] 2
[1] "Svd done!"
[1] "data3 update done!"
[1] 3
[1] "Svd done!"
[1] "data3 update done!"
[1] 4
[1] "Svd done!"
[1] "data3 update done!"
[1] 5
[1] "Svd done!"
[1] "data3 update done!"
[1] "Computing Similarity Matrix"
10 out of 1682
20 out of 1682
30 out of 1682
40 out of 1682
50 out of 1682
60 out of 1682
70 out of 1682
80 out of 1682
90 out of 1682
100 out of 1682
110 out of 1682
120 out of 1682
130 out of 1682
140 out of 1682
150 out of 1682
160 out of 1682
170 out of 1682
180 out of 1682
190 out of 1682
200 out of 1682
210 out of 1682
220 out of 1682
230 out of 1682
240 out of 1682
250 out of 1682
260 out of 1682
270 out of 1682
280 out of 1682
290 out of 1682
300 out of 1682
310 out of 1682
320 out of 1682
330 out of 1682
340 out of 1682
350 out of 1682
360 out of 1682
370 out of 1682
380 out of 1682
390 out of 1682
400 out of 1682
410 out of 1682
420 out of 1682
430 out of 1682
440 out of 1682
450 out of 1682
460 out of 1682
470 out of 1682
480 out of 1682
490 out of 1682
500 out of 1682
510 out of 1682
520 out of 1682
530 out of 1682
540 out of 1682
550 out of 1682
560 out of 1682
570 out of 1682
580 out of 1682
590 out of 1682
600 out of 1682
610 out of 1682
620 out of 1682
630 out of 1682
640 out of 1682
650 out of 1682
660 out of 1682
670 out of 1682
680 out of 1682
690 out of 1682
700 out of 1682
710 out of 1682
720 out of 1682
730 out of 1682
740 out of 1682
750 out of 1682
760 out of 1682
770 out of 1682
780 out of 1682
790 out of 1682
800 out of 1682
810 out of 1682
820 out of 1682
830 out of 1682
840 out of 1682
850 out of 1682
860 out of 1682
870 out of 1682
880 out of 1682
890 out of 1682
900 out of 1682
910 out of 1682
920 out of 1682
930 out of 1682
940 out of 1682
950 out of 1682
960 out of 1682
970 out of 1682
980 out of 1682
990 out of 1682
1000 out of 1682
1010 out of 1682
1020 out of 1682
1030 out of 1682
1040 out of 1682
1050 out of 1682
1060 out of 1682
1070 out of 1682
1080 out of 1682
1090 out of 1682
1100 out of 1682
1110 out of 1682
1120 out of 1682
1130 out of 1682
1140 out of 1682
1150 out of 1682
1160 out of 1682
1170 out of 1682
1180 out of 1682
1190 out of 1682
1200 out of 1682
1210 out of 1682
1220 out of 1682
1230 out of 1682
1240 out of 1682
1250 out of 1682
1260 out of 1682
1270 out of 1682
1280 out of 1682
1290 out of 1682
1300 out of 1682
1310 out of 1682
1320 out of 1682
1330 out of 1682
1340 out of 1682
1350 out of 1682
1360 out of 1682
1370 out of 1682
1380 out of 1682
1390 out of 1682
1400 out of 1682
1410 out of 1682
1420 out of 1682
1430 out of 1682
1440 out of 1682
1450 out of 1682
1460 out of 1682
1470 out of 1682
1480 out of 1682
1490 out of 1682
1500 out of 1682
1510 out of 1682
1520 out of 1682
1530 out of 1682
1540 out of 1682
1550 out of 1682
1560 out of 1682
1570 out of 1682
1580 out of 1682
1590 out of 1682
1600 out of 1682
1610 out of 1682
1620 out of 1682
1630 out of 1682
1640 out of 1682
1650 out of 1682
1660 out of 1682
1670 out of 1682
1680 out of 1682
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run learn '/home/mlcomp/worker1/scratch/program0/../dataset2/train' --- OK [377s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.in'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.in' --- OK [1s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTrain.in' '/home/mlcomp/worker1/scratch/program0/evalTrain.out'
[1] "/home/mlcomp/worker1/scratch/program0/evalTrain.in"
[1] "/home/mlcomp/worker1/scratch/program0/evalTrain.out"
[1] "Computing SVD..."
[1] "Computing KNN and merging..."
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTrain.in' '/home/mlcomp/worker1/scratch/program0/evalTrain.out' --- OK [101s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.out'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.out' --- OK [1s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.in'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.in' --- OK [1s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTest.in' '/home/mlcomp/worker1/scratch/program0/evalTest.out'
[1] "/home/mlcomp/worker1/scratch/program0/evalTest.in"
[1] "/home/mlcomp/worker1/scratch/program0/evalTest.out"
[1] "Computing SVD..."
[1] "Computing KNN and merging..."
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTest.in' '/home/mlcomp/worker1/scratch/program0/evalTest.out' --- OK [28s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.out'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.out' --- OK [0s]
real 8m30.944s
user 8m16.539s
sys 0m4.348s
Run specification
supervised-learning: Main entry for supervised learning for training and testing a program on a dataset.
(learner:Program) xterm-knnsvd_shrunk_unbias_rev-r: KNN with 21 neighbors and cosine distance, and SVD with EM, 10 iterations, and K=10. Combined using fixed weights of 1/3 and 2/3 resp.
(dataset:Dataset) movielens100k: 100K MovieLens movie ratings dataset from http://www.grouplens.org/. 100,000 ratings (1-5) from 943 users on 1682 movies. Test set contains exactly 10 ratings per user.
See included README.txt for more information.
(stripper:Program[Strip]) collaborativefiltering-utils: Validates, inspects, and evaluates a dataset in CollaborativeFiltering format.
(evaluator:Program[Evaluate]) collaborativefiltering-utils: Validates, inspects, and evaluates a dataset in CollaborativeFiltering format.
When you generate a run, you can set a time limit for the run (no more than 24 hours). After that point, we will terminate the program.
Your program can use 1.5GB of memory. More information here.
Go to the page for the run and look at the log file for signs of the responsible error.
You can also download the run and run it locally on your machine (a README file should
be included in the download which provides more information).
We said that a run was simply a program/dataset pair, but that's not the full story.
A run actually includes other helper programs such as the evaluation program and
various programs for reductions (e.g., one-versus-all, hyperparameter tuning).
More formally, a run is a given by a run specification,
which can be found on the page for any run.
A run specification is a tree where each internal node represents a program
and its children represents the arguments to be passed into its constructor.
For example, the one-versus-all program takes your binary classification program
as a constructor argument and behaves like a multiclass classification program.
Must be logged in to post comments.