ERL Consumer Scoring and Standings 2016/2017

The ERL Consumer Service Robots (previously known as ERL Service Robots) is composed of multiple Local Tournaments, held in different research labs across Europe, with certified test beds, and a few competitions as part of Major Tournaments, such as RoboCup. Teams participate in a minimum of 2 tournaments (Local and/or Major) per year and get scores based on their performances. A final end of year score is computed for each team, per Task Benchmark (TBM) and Functionality Benchmark (FBM), using the best two participations in tournaments, and teams are ranked based on their final score.

The final scoring and standings for the ERL Consumer Service Robots Challenge Season 2016/2017 are the ones below.

Prizes for the top teams (per TBM and per FBM where they participated) were awarded during the European Robotics Forum (ERF) 2017 in Edinburgh, 22-24 March.

 

Task Benchmarks

TBM1:  Getting to know my home

A – Achievements
P – Penalties
Yellow indicates the team has the minimum required (2) participations

TBM4: Visit my home (Navigation)

TBM5: GPSR

 

Functionality Benchmarks

FBM1: Object Perception

FBM3: Speech Understanding

FCR – Full Command Recognition
AC – Action Classification
WER – Word Error Rate
SR acc – Speech Recognition Accuracy