Toolympics Challenge 2023: Updates, Results, Successes of the Formal-Methods Competitions

TOOLympics 2023 was the third edition of a series of events to showcase competitions in the area of formal methods, colocated with the European Joint Conferences on Theory and Practice of Software (ETAPS 2023), held in April n Paris, France. The goal is to acknowledge the achievements of the various research competitions and comparative evaluations broadly related to the field of formal methods, to explain to the audience which tools from the field of formal methods they evaluate, and to understand their commonalities and differences. The developers of the participating tools typically participate in the competitions and evaluations, choosing the right parameters for the tools, or the best workflow for the approach.

A total of ten competitions joined TOOLympics in 2023 and were presented at the event: CHC-COMP, MCC, QComp, ARCH-COMP, RERS, SL-COMP, SV-COMP, Test-Comp, VerifyThis, and the VT-Long-Term Challenge. Six of these are represented in this proceedings volume as papers: ARCH-COMP, CHC-COMP, MCC, QComp, VerifyThis, and the VerifyThis Long-Term Challenge. Each of these papers was peer-reviewed in single-blind mode.

The papers will be of value to researchers and practitioners who employ formal methods approaches such as model checking, program analysis, probabilistic analysis, runtime verification, SAT solving, and SMT solving.