Scenario-based Automatic Testing of a Machine Learning Solution with the Human in the Loop - Intelligence Collective et Interaction
Communication Dans Un Congrès Année : 2024

Scenario-based Automatic Testing of a Machine Learning Solution with the Human in the Loop

Résumé

More and more applications rely on machine learning, particularly interactive online learning, to make decisions tailored to human needs and situation. Like any program, the behavior of learning programs must be verified and validated. Testing is one way to achieve this.

In this paper, we analyze the challenges of testing machine learning solutions, focusing on programs that learn online and in interaction with human users. Given the issues arising from the presence of the human in the loop, the non-determinism and the dynamics of online learning, we propose a scenario-based approach. We apply it to the test of OCE, a learning program that builds applications in ambient environments with the user in the loop. In addition, two prototype tools are presented to implement test scenarios and automate their execution for the assessment of OCE.

Fichier sous embargo
Fichier sous embargo
0 5 23
Année Mois Jours
Avant la publication
mercredi 9 avril 2025
Fichier sous embargo
mercredi 9 avril 2025
Connectez-vous pour demander l'accès au fichier

Dates et versions

hal-04726773 , version 1 (09-10-2024)

Licence

Identifiants

  • HAL Id : hal-04726773 , version 1

Citer

Maxence Demougeot, Sylvie Trouilhet, Jean-Paul Arcangeli, Françoise Adreit. Scenario-based Automatic Testing of a Machine Learning Solution with the Human in the Loop. Second Workshop on Hybrid Human-Machine Learning and Decision Making (co-located with the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in DataBases, Sep 2024, Vilnius, Lithuania. ⟨hal-04726773⟩
0 Consultations
0 Téléchargements

Partager

More