An Approach for Platform-Independent Online Controlled Experimentation

Authors: Florian Auer, Michael Felderer

Online controlled experimentation is an established technique to assess ideas for software features. Current approaches to conduct experimentation are based on experimentation platforms. However, each experimentation platform has its own explicit properties and implicit assumptions about an experiment. As a result, experiments are incomplete, difficult to repeat, and not comparable across experimentation platforms or platform versions. Our approach separates the experiment definition from the experimentation platform. This makes the experimentation infrastructure-less dependent on the experimentation platform. Requirements on the independent experiment definition are researched and an architecture to implement the approach is proposed. A proof-of-concept demonstrates the feasibility and achieved level of independence from the platform.

Presented by: Michael Felderer
Company: Universität Innsbruck

Talk language: English
Level: Advanced
Target group:

Partner der Konferenz 2022

ASQF e.V ATB - Austrian Testing Board coderskitchen dpunkt.verlag GmbH Fortiss GmbH GTB - German Testing Board Heise Medien GmbH & Co. KG iSQI GmbH IT Verlag für Informationstechnik GmbH SIGS DATACOM GmbH TU Wien, Institut für Information Systems Engineering, CDL-SQI WKO - Wirtschaftskammer