Release 1.12.4 · IBM/unitxt

Main changes

Enable to define benchmark in Unitxt by adding the ability to produce scores of groups based on task attributes and recipe metadata. For more information see https://www.unitxt.ai/en/latest/docs/benchmark.html by @elronbandel in #1130
Enable inference/production APIs to support invocation by task without specifying a card. It enables using any task in the Unitxt catalog as an inference function. Check https://www.unitxt.ai/en/latest/docs/production.html for details (#957)
Add support for multi-modality. For details see https://www.unitxt.ai/en/latest/docs/multimodality.html by @elronbandel in #1175

Add LLM as judge ensemble metrics, and add LLMaaJ ensemble example by @pvn25 in #1081
Refactor RenameFields operator to Rename. The old operator is still supported but raises a deprecation warning by @elronbandel in #1123

Make cache compatible with python 3.8 by @elronbandel in #1172
Deprecated field used to print warning message with wrong reason @dafnapension in #1174

Update llm_as_judge.py --- copy edits (grammar, consistency, clarity) by @welisheva22 in #1164
Update formats.py --- copy edits (grammar, consistency, clarity) by @welisheva22 in #1163
Update loaders.py --- copy edits (grammar, consistency, clarity) by @welisheva22 in #1162
Update card.py - minor documentation changes by @welisheva22 in #1161
Update adding_dataset.rst - a few more minor documentation changes by @welisheva22 in #1160
Update artifact.py --- documentation edits (grammar, consistency, cla… by @welisheva22 in #1159
Update glossary.rst --- copy edits (grammar, consistency, clarity) by @welisheva22 in #1155
Update helm.rst --- copy edits (grammar, consistency, clarity) by @welisheva22 in #1154
Update operators.py --- copy edits (grammar, consistency, clarity) - take 2 by @welisheva22 in #1158
Docfix: Fix typo in Installation doc by @yifanmai in #1181