It the image project id is not set and there is no depot.json file at the root of the repository, then the this action will error with a very unclear error message:
Error: error retrieving projects: permission_denied: Not authorized
I spent too much time looking for errors in my github permissions before I found the real culprit.