`Build PR Container Image` almost always fails

This job seems to fail almost all the time: https://github.com/trustyai-explainability/llama-stack-provider-lmeval/actions/workflows/pr-container-build.yaml

Either it should be fixed for PRs and made as to not run on them