Benchmarks: explicit group
When declaring a benchmark, the local names of its models are used to group benchmarks together during the inference stage of a full Tezt run.
However, benchmarks are being changed to have exactly one model, so this calls for a simplification and a clarification: let's make this grouping explicit.
-
Add a groupoptional value to all benchmarks: !8541 (merged).- It should be set to
Some group_namefor benchmarks that need to be grouped together, andNonefor others. - #4691 (closed) makes some propositions about what benchmarks could be grouped together.
- It should be set to
-
Add a groupfield of typestring optiontosrc/proto_alpha/lib_benchmarks_proto/Benchmarks_proto.Benchmark.S.- At registration time, the local name of the model should be set to
group_nameifgroup = Some group_name, and to an arbitrary name otherwise, i.e. whengroup = None(for instance the benchmark name suffixed by/model, which is already the case withBenchmarks_proto.Registration.register).
- At registration time, the local name of the model should be set to
Edited by Nicolas Ayache