System Info
.
Information
🐛 Describe the bug
Typo exists in one of the prompts from the MMLU-Pro benchmark (math) provided for llama-3.1-8B-Instruct-evals.
This could potentially lead to inaccuracies during model evaluation and reduce the quality of the benchmark.
It seems that \f should be replaced with \f
There also seem to be issues with the use of \ in other parts as well.
Error logs
.
Expected behavior
The correct version of the prompt should be:
