About

The STAMINA (STAte Machine INference Approaches) competition aims to identify the best technique for learning deterministic finite state machines (FSMs). It extends former competitions, especially Abbadingo, and focusses on the complexity of the learning with respect to the alphabet size. Stamina relies on an adapted generation protocol for target machines and strings. It aims to encourage the development of novel learning algorithms and to encourage cross-fertilization between the machine learning and software engineering communities. A prize of £700 (about $1146) will be awarded to the winner.

The most significant contributions will be selected by the competition organizers and their authors will also be invited to submit their work in a special issue of the Journal of Empirical Software Engineering.

Additional details are given on the protocol page; see also instructions to participate. Implementation of baseline learning algorithms is provided. You can also download the training and test samples, and create a competitor account (required to submit results).

The competition finishes on the 31st December 2010.

Competition grid

The grids below provide feedback about the competition results. The first one presents cell winners and best challengers so far.

Cell winners and best challengers
Sparsity of the training sample
100%50%25%12.5%
Alphabet size 2MVdPyA/EquipoMVdPyA/Menor
5
10
20
50

This second grid presents statistics about challengers and submissions: # challengers with the cell broken / # challengers with at least one problem broken / total # of submissions for the cell.

Statistics about the submissions
Sparsity of the training sample
100%50%25%12.5%
Alphabet size 21 / 1 / 320 / 2 / 1400 / 0 / 260 / 0 / 15
50 / 0 / 320 / 0 / 730 / 0 / 40 / 0 / 0
100 / 0 / 00 / 0 / 10 / 0 / 00 / 0 / 1
200 / 0 / 00 / 0 / 10 / 0 / 00 / 0 / 0
500 / 0 / 10 / 0 / 00 / 0 / 00 / 0 / 0

Organizers & Contact

Please send an email to stamina@listes.uclouvain.be with any questions.