MLcomp version alpha Statistics: 1403 users, 461 datasets, 360 programs, 16577 runs (0 queued, 0 running), 0 workers

Run 1322

Creator	pliang
Program	aileenchen-matrix_factorization1m-r
Dataset	eachmovie-1to5
Task type	CollaborativeFiltering
Created	28d17h ago

Status: Done!

Total Time	11h59m
Max Memory Usage	898M
Domain	CollaborativeFiltering
Learn time	11h54m
Train RMSE	1.02
Train MAE	0.803
Predict train time	4m50s
Test RMSE	1.04
Test MAE	0.821
Predict test time

Log file

Usage: "run learn trainingFileName" OR "run predict testFileName predictionFileName"
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run learn '/home/mlcomp/worker1/scratch/program0/../dataset2/train'
[1] "K="
[1] 3
[1] 1.215217
[1] 1.088974
[1] 1.058415
[1] 1.045322
[1] 1.038306
[1] 1.034041
[1] 1.031226
[1] "Done w/ K, xval_err ="
[1] 1.034426
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run learn '/home/mlcomp/worker1/scratch/program0/../dataset2/train' --- OK [42886s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.in'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.in' --- OK [6s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTrain.in' '/home/mlcomp/worker1/scratch/program0/evalTrain.out'
[1] "/home/mlcomp/worker1/scratch/program0/evalTrain.in"
[1] "/home/mlcomp/worker1/scratch/program0/evalTrain.out"
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTrain.in' '/home/mlcomp/worker1/scratch/program0/evalTrain.out' --- OK [290s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.out'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.out' --- OK [12s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.in'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.in' --- OK [0s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTest.in' '/home/mlcomp/worker1/scratch/program0/evalTest.out'
[1] "/home/mlcomp/worker1/scratch/program0/evalTest.in"
[1] "/home/mlcomp/worker1/scratch/program0/evalTest.out"
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTest.in' '/home/mlcomp/worker1/scratch/program0/evalTest.out' --- OK [6s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.out'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.out' --- OK [0s]

real	720m0.836s
user	202m4.274s
sys	516m3.455s

Run specification

• supervised-learning: Main entry for supervised learning for training and testing a program on a dataset.
  • (learner:Program) aileenchen-matrix_factorization1m-r: Matrix factorization using stochiastic gradient descent
  • (dataset:Dataset) eachmovie-1to5: Modified EachMovie movie ratings dataset from HP/Compaq (more information on http://www.grouplens.org/). The original EachMovie dataset contained 2,811,983 ratings (1-6 stars) entered by 72,916 users for 1628 different movies. This sub-dataset includes the ratings of 30,000 randomly selected users with 20 or more ratings. A single rating from each user was withheld to form the test set. Ratings values outside of the 1-6 range have been discarded. Finally, ratings in the range 1-6 were mapped to the range 1-5 via r = 1 + (r-1)*(4/5).
  • (stripper:Program[Strip]) collaborativefiltering-utils: Validates, inspects, and evaluates a dataset in CollaborativeFiltering format.
  • (evaluator:Program[Evaluate]) collaborativefiltering-utils: Validates, inspects, and evaluates a dataset in CollaborativeFiltering format.

Results

• doTest:
  • evaluate:
    • meanAbsoluteError: 0.821140014537632
    • meanSquaredError: 1.0906607089405
    • numExamples: 29998
    • rootMeanSquaredError: 1.04434702515041
    • success: true
    • time: 0
  • predict:
    • success: true
    • time: 6
  • strip:
    • success: true
    • time: 0
• doTrain:
  • evaluate:
    • meanAbsoluteError: 0.802520458717514
    • meanSquaredError: 1.0384398160649
    • numExamples: 2079628
    • rootMeanSquaredError: 1.01903867250703
    • success: true
    • time: 12
  • predict:
    • success: true
    • time: 290
  • strip:
    • success: true
    • time: 6
• exitCode: 0
• learn:
  • success: true
  • time: 42886
• success: true

Comments: