Skip to content

compress_state_machine functionality -- unable to download code package. #2627

@alper-t

Description

@alper-t

I have a very long list of packages that I install via pypi, and I get the

"StatusReason": "Container Overrides length must be at most 8192"

I’m happy to see that this has been fixed in version 2.18.3, using the command:

Deployer(flow, environment="pypi").step_functions().create(max_workers=5, compress_state_machine=True)

But now I get the following error:

1759499526663,Downloading code package...
1759499526675,"  File ""<string>"", line 1"
1759499526675,"    import boto3, os; ep=os.getenv(\""METAFLOW_S3_ENDPOINT_URL\""); boto3.client(\""s3\"", **({\""endpoint_url\"":ep} if ep else {})).download_file(\""***\"", \""***/data/c3/c365cb66d0989afafb2a3ec7ee7bcb01504793a1\"", \""job.tar\"")"
1759499526675,                                    ^
1759499526675,SyntaxError: unexpected character after line continuation character
1759499536683,/tmp/step_command.sh: line 1: 2025-10-03T13:52:16.681827Z: command not found
1759499536683,/tmp/step_command.sh: line 1: task: command not found
1759499536684,/tmp/step_command.sh: line 1: 0: command not found
1759499536684,/tmp/step_command.sh: line 1: 2025-10-03T13:52:16.681827065+00:00]Failed: command not found
1759499536684,Failed to download code package from s3://***/c3/c365cb66d0989afafb2a3ec7ee7bcb01504793a1 after 6 tries. Exiting...

I replace the S3 bucketname with ***, but both bucketname and key are correct.
Does anyone know why this is happening?

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions