evaluation-framework

This is the repository of our article published in RecSys 2019 "Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches" and of several follow-up studies.

Expressive is a cross-platform expression parsing and evaluation framework. The cross-platform nature is achieved through compiling for .NET Standard so it will run on practically any platform.

Official repository of RankEval: An Evaluation and Analysis Framework for Learning-to-Rank Solutions.

Optical Flow Dataset and Benchmark for Visual Crowd Analysis

OD-test: A Less Biased Evaluation of Out-of-Distribution (Outlier) Detectors (PyTorch)

BIRL: Benchmark on Image Registration methods with Landmark validations

The implementation of the paper "Evaluating Coherence in Dialogue Systems using Entailment"

Python-based tools for pre-, post-processing, validating, and curating spike sorting datasets.

Power Flows DMN - Powerful decisions and rules engine

Evaluation Framework for Dependency Analysis (EFDA)

Train, evaluate, and optimize implicit feedback-based recommender systems.

quica is a tool to run inter coder agreement pipelines in an easy and effective ways. Multiple measures are run and results are collected in a single table than can be easily exported in Latex

This is a machine learning framework that enables developers to iterate fast over different ML architecture designs.

An easy-to-use tool for evaluating tracking algorithms on many different benchmarks like OTB and Temple-Color

ETUDE (Evaluation Tool for Unstructured Data and Extractions) is a Python-based tool that provides consistent evaluation options across a range of annotation schemata and corpus formats

A suite of experiments for evaluating open-source binary taint trackers.

It is an evaluation framework for evaluating and comparing graph embedding techniques

An Extendable Evaluation Pipeline for Named Entity Drill-Down Analysis

An experimental information retrieval framework and a workbench for innovation in entity-oriented search.

🪐 A framework for distributed load testing experiments

Army ANT installation via Docker Compose.

Tool to orchestrate the Performance Evaluation Cycle of a company.

RRE Demo Repository

a Python package for executing automated evaluations on generated natural language responses. Originally developed for the ChatEval platform and released for research reproducibility.

Web-Interface for the evaluation of the different GDSC entries.

"Evaluation procedures for forecasting with spatio-temporal data" -- ECML 2018

This is a diagnostic package for earth system modeling.

A PyTorch implementation of Matrix Factorization and Factorization Machines