STATSREP-ML: Statistical Evaluation & Reporting Framework for Machine Learning Results

In this report, we present STATSREP-ML, which is an open-source solution for automating the process of evaluating machine-learning results. It calculates qualitative statistics, performs the appropriate tests and reports them in a comprehensive way. It largely, but not exclusively, relies on well-tested and robust statistics implementations in R, and uses the tests the machine-learning community largely agreed upon.