Validating large data file (150GB) is trying to write the entire file to local temp space - error upon not enough local space

[scholes-ds]

Checked for duplicates

Yes - I've already checked

🐛 Describe the bug

When our data archivist runs validate on a staged copy of very large data files in preparation for a PDS3 to PDS4 data conversion, validate throws a “not enough space on the disk” error. This is correct because we don't have that much disk space on the processing VM. Does it really need to copy all of the data file bytes locally?
The directory with contents that will be converted to PDS4: https://pds-geosciences.wustl.edu/mro/mro-m-sharad-5-3d-v1/mrosh_3001/data/

🕵️ Expected behavior

We expected validate to complete successfully.

📜 To Reproduce

1. Make a temp xml label or we can provide one for data files in here: https://pds-geosciences.wustl.edu/mro/mro-m-sharad-5-3d-v1/mrosh_3001/data/

2. There are also very large data files in the following archive location. Apparently a different error was thrown on these large files at the time, and it was not reported.

3. https://pds-geosciences.wustl.edu/grail/grail-l-lgrs-5-rdr-v1/grail_1001/shbdr/

...

🖥 Environment Info

• Version of this software: Validate 3.7
• Operating System: Windows Server 2012R2
  ...

📚 Version of Software Used

Validate 3.7

🩺 Test Data / Additional context

No response

🦄 Related requirements

🦄 #xyz

⚙️ Engineering Details

No response

🎉 Integration & Test

No response

[al-niessner]

@scholes-ds

Please provide a label. I suspect that it will always try to download and test the data file unless you provide --skip-content-validation. Therefore, can you please give me your validate command line as well. Are you alright with --skip-content-validation since it seems to be a conversion from PDS3 to PDS4? If not, then I see no way around downloading it because to validate content, validate has to open the file and read its content.

That said, if you are skipping content validation and validate is still downloading the data file, then I have to understand why but off the top of my head it would seem erroneous behavior; in other words, I will need the label and your command arguments.