MLcomp version alpha Statistics: 1403 users, 461 datasets, 360 programs, 16577 runs (0 queued, 0 running), 0 workers

Run 1233

Creator	lester
Program	mjanderson-matrix-factorization-r
Dataset	eachmovie
Task type	CollaborativeFiltering
Created	28d16h ago

Status: Done!

Total Time	51m0s
Max Memory Usage	1266M
Domain	CollaborativeFiltering
Learn time	44m46s
Train RMSE	0.855
Train MAE	0.641
Predict train time	5m35s
Test RMSE	1.17
Test MAE	0.907
Predict test time

Log file

Usage: "run learn trainingFileName" OR "run predict testFileName predictionFileName"
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run learn '/home/mlcomp/worker1/scratch/program0/../dataset2/train'
[1] "root mean squared error"
[1] 1.869153
[1] "root mean squared error"
[1] 1.264150
[1] "root mean squared error"
[1] 1.246449
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run learn '/home/mlcomp/worker1/scratch/program0/../dataset2/train' --- OK [2686s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.in'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.in' --- OK [6s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTrain.in' '/home/mlcomp/worker1/scratch/program0/evalTrain.out'
[1] "/home/mlcomp/worker1/scratch/program0/evalTrain.in"
[1] "/home/mlcomp/worker1/scratch/program0/evalTrain.out"
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTrain.in' '/home/mlcomp/worker1/scratch/program0/evalTrain.out' --- OK [335s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.out'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/train' '/home/mlcomp/worker1/scratch/program0/evalTrain.out' --- OK [13s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.in'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program3 && ./run stripLabels '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.in' --- OK [0s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTest.in' '/home/mlcomp/worker1/scratch/program0/evalTest.out'
[1] "/home/mlcomp/worker1/scratch/program0/evalTest.in"
[1] "/home/mlcomp/worker1/scratch/program0/evalTest.out"
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program1 && ./run predict '/home/mlcomp/worker1/scratch/program0/evalTest.in' '/home/mlcomp/worker1/scratch/program0/evalTest.out' --- OK [24s]
=== Starting: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.out'
=== Finished: cd /home/mlcomp/worker1/scratch/program0/../program4 && ./run evaluate '/home/mlcomp/worker1/scratch/program0/../dataset2/test' '/home/mlcomp/worker1/scratch/program0/evalTest.out' --- OK [0s]

real	51m4.638s
user	50m21.845s
sys	0m30.858s

Run specification

• supervised-learning: Main entry for supervised learning for training and testing a program on a dataset.
  • (learner:Program) mjanderson-matrix-factorization-r: Matrix factorization
  • (dataset:Dataset) eachmovie: EachMovie movie ratings dataset from HP/Compaq (more information on http://www.grouplens.org/). The original EachMovie dataset contained 2,811,983 ratings (1-6 stars) entered by 72,916 users for 1628 different movies. This sub-dataset includes the ratings of 30,000 randomly selected users with 20 or more ratings. A single rating from each user was withheld to form the test set. Ratings values outside of the 1-6 range have been discarded.
  • (stripper:Program[Strip]) collaborativefiltering-utils: Validates, inspects, and evaluates a dataset in CollaborativeFiltering format.
  • (evaluator:Program[Evaluate]) collaborativefiltering-utils: Validates, inspects, and evaluates a dataset in CollaborativeFiltering format.

Results

• doTest:
  • evaluate:
    • meanAbsoluteError: 0.906691123008194
    • meanSquaredError: 1.36940270574213
    • numExamples: 29998
    • rootMeanSquaredError: 1.17021481179403
    • success: true
    • time: 0
  • predict:
    • success: true
    • time: 24
  • strip:
    • success: true
    • time: 0
• doTrain:
  • evaluate:
    • meanAbsoluteError: 0.64095425703539
    • meanSquaredError: 0.730882706577338
    • numExamples: 2079628
    • rootMeanSquaredError: 0.85491678342242
    • success: true
    • time: 13
  • predict:
    • success: true
    • time: 335
  • strip:
    • success: true
    • time: 6
• exitCode: 0
• learn:
  • success: true
  • time: 2686
• success: true

Comments: