When inference, why Pi05 connect to get tokenizer_config.json?

[shs822]

my network connect not well on hgface, I want to know why code connect to this file, don't it contained in my trained policy?

The PI05 model is a direct port of the OpenPI implementation. This implementation follows the original OpenPI structure for compatibility. Original implementation: https://github.com/Physical-Intelligence/openpi C:\Users\sunhaosen\.conda\envs\lerobot_newpi\lib\site-packages\pydantic\_internal\_generate_schema.py:2249: UnsupportedFieldAttributeWarning: The 'repr' attribute with value False was provided to the Field()function, which has no effect in the context it was used. 'repr' is field-specific metadata, and can only be attached to a model field usingAnnotatedmetadata or by assignment. This may have happened because anAnnotatedtype alias using thetypestatement was used, or if theField()function was attached to a single member of a union type. warnings.warn( C:\Users\sunhaosen\.conda\envs\lerobot_newpi\lib\site-packages\pydantic\_internal\_generate_schema.py:2249: UnsupportedFieldAttributeWarning: The 'frozen' attribute with value True was provided to theField()function, which has no effect in the context it was used. 'frozen' is field-specific metadata, and can only be attached to a model field usingAnnotatedmetadata or by assignment. This may have happened because anAnnotatedtype alias using thetypestatement was used, or if theField()` function was attached to a single member of a union type.
warnings.warn(
Loading model from: outputs\train\pi05\pick_cubes_right_base\020000\pretrained_model
✓ Loaded state dict from model.safetensors
WARNING:root:Vision embedding key might need handling: model.paligemma_with_expert.paligemma.model.vision_tower.vision_model.embeddings.patch_embedding.bias
WARNING:root:Vision embedding key might need handling: model.paligemma_with_expert.paligemma.model.vision_tower.vision_model.embeddings.patch_embedding.weight
Warning: Could not remap state dict keys: Error(s) in loading state_dict for PI05Policy:
Missing key(s) in state_dict: "model.paligemma_with_expert.paligemma.model.language_model.embed_tokens.weight".
'(MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B4C70>, 'Connection to huggingface.co timed out. (connect timeout=10)'))"), '(Request ID: ebc39613-2607-4664-a128-d72751abe94e)')' thrown while requesting HEAD https://huggingface.co/google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json
WARNING:huggingface_hub.utils._http:'(MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B4C70>, 'Connection to huggingface.co timed out. (connect timeout=10)'))"), '(Request ID: ebc39613-2607-4664-a128-d72751abe94e)')' thrown while requesting HEAD https://huggingface.co/google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json
Retrying in 1s [Retry 1/5].
WARNING:huggingface_hub.utils._http:Retrying in 1s [Retry 1/5].
'(MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B4F10>, 'Connection to huggingface.co timed out. (connect timeout=10)'))"), '(Request ID: ba7ab439-c7d8-4068-a412-70d0aa5ba34f)')' thrown while requesting HEAD https://huggingface.co/google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json
WARNING:huggingface_hub.utils._http:'(MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B4F10>, 'Connection to huggingface.co timed out. (connect timeout=10)'))"), '(Request ID: ba7ab439-c7d8-4068-a412-70d0aa5ba34f)')' thrown while requesting HEAD https://huggingface.co/google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json
Retrying in 2s [Retry 2/5].
WARNING:huggingface_hub.utils._http:Retrying in 2s [Retry 2/5].
'(MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B5210>, 'Connection to huggingface.co timed out. (connect timeout=10)'))"), '(Request ID: 0cf3c196-966b-4ec6-ac44-8cb04e055fda)')' thrown while requesting HEAD https://huggingface.co/google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json
WARNING:huggingface_hub.utils._http:'(MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B5210>, 'Connection to huggingface.co timed out. (connect timeout=10)'))"), '(Request ID: 0cf3c196-966b-4ec6-ac44-8cb04e055fda)')' thrown while requesting HEAD https://huggingface.co/google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json
Retrying in 4s [Retry 3/5].
WARNING:huggingface_hub.utils._http:Retrying in 4s [Retry 3/5].
'(MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B5510>, 'Connection to huggingface.co timed out. (connect timeout=10)'))"), '(Request ID: 9657c3e2-0133-4814-abdb-36cd89ad2e94)')' thrown while requesting HEAD https://huggingface.co/google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json
WARNING:huggingface_hub.utils._http:'(MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B5510>, 'Connection to huggingface.co timed out. (connect timeout=10)'))"), '(Request ID: 9657c3e2-0133-4814-abdb-36cd89ad2e94)')' thrown while requesting HEAD https://huggingface.co/google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json
Retrying in 8s [Retry 4/5].
WARNING:huggingface_hub.utils._http:Retrying in 8s [Retry 4/5].
'(MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B5810>, 'Connection to huggingface.co timed out. (connect timeout=10)'))"), '(Request ID: e75392e3-8974-4a1f-8526-f1a41d31dd99)')' thrown while requesting HEAD https://huggingface.co/google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json
WARNING:huggingface_hub.utils._http:'(MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B5810>, 'Connection to huggingface.co timed out. (connect timeout=10)'))"), '(Request ID: e75392e3-8974-4a1f-8526-f1a41d31dd99)')' thrown while requesting HEAD https://huggingface.co/google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json
Retrying in 8s [Retry 5/5].
WARNING:huggingface_hub.utils._http:Retrying in 8s [Retry 5/5].
'(MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B53C0>, 'Connection to huggingface.co timed out. (connect timeout=10)'))"), '(Request ID: d81fd06c-3ba0-4aa3-a8e6-bdf165d7e729)')' thrown while requesting HEAD https://huggingface.co/google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json
WARNING:huggingface_hub.utils._http:'(MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B53C0>, 'Connection to huggingface.co timed out. (connect timeout=10)'))"), '(Request ID: d81fd06c-3ba0-4aa3-a8e6-bdf165d7e729)')' thrown while requesting HEAD https://huggingface.co/google/paligemma-3b-pt-224/resolve/main/tokenizer_config.json
Traceback (most recent call last):
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\urllib3\connection.py", line 198, in _new_conn
sock = connection.create_connection(
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\urllib3\util\connection.py", line 85, in create_connection
raise err
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\urllib3\util\connection.py", line 73, in create_connection
sock.connect(sa)
TimeoutError: [WinError 10060] 由于连接方在一段时间后没有正确答复或连接的主机没有反应，连接尝试失败。

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\urllib3\connectionpool.py", line 787, in urlopen
response = self._make_request(
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\urllib3\connectionpool.py", line 488, in _make_request
raise new_e
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\urllib3\connectionpool.py", line 464, in _make_request
self._validate_conn(conn)
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\urllib3\connectionpool.py", line 1093, in _validate_conn
conn.connect()
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\urllib3\connection.py", line 753, in connect
self.sock = sock = self._new_conn()
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\urllib3\connection.py", line 207, in _new_conn
raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPSConnection object at 0x000002464D4B5C00>, 'Connection to huggingface.co timed out. (connect timeout=None)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\requests\adapters.py", line 644, in send
resp = conn.urlopen(
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\urllib3\connectionpool.py", line 841, in urlopen
retries = retries.increment(
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\urllib3\util\retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/google/paligemma-3b-pt-224/tree/main/additional_chat_templates?recursive=False&expand=False (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B5C00>, 'Connection to huggingface.co timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "D:\new_projects\Robot\lerobot\src\lerobot\processor\pipeline.py", line 906, in _instantiate_step
return step_class(**merged_cfg)
File "", line 10, in init
File "D:\new_projects\Robot\lerobot\src\lerobot\processor\tokenizer_processor.py", line 102, in post_init
self.input_tokenizer = AutoTokenizer.from_pretrained(self.tokenizer_name)
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\transformers\models\auto\tokenization_auto.py", line 1050, in from_pretrained
return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs)
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\transformers\tokenization_utils_base.py", line 1957, in from_pretrained for template in list_repo_templates(
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\transformers\utils\hub.py", line 161, in list_repo_templates
return [
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\transformers\utils\hub.py", line 161, in
return [
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\huggingface_hub\hf_api.py", line 3188, in list_repo_tree
for path_info in paginate(path=tree_url, headers=headers, params={"recursive": recursive, "expand": expand}):
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\huggingface_hub\utils_pagination.py", line 36, in paginate
r = session.get(path, params=params, headers=headers)
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\requests\sessions.py", line 602, in get
return self.request("GET", url, **kwargs)
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\requests\sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\requests\sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\huggingface_hub\utils_http.py", line 95, in send
return super().send(request, *args, **kwargs)
File "C:\Users\sunhaosen.conda\envs\lerobot_newpi\lib\site-packages\requests\adapters.py", line 665, in send
raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: (MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/google/paligemma-3b-pt-224/tree/main/additional_chat_templates?recursive=False&expand=False (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B5C00>, 'Connection to huggingface.co timed out. (connect timeout=None)'))"), '(Request ID: 67e3fed6-6ea2-4749-be92-f9ffd3cfeec0)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "D:\new_projects\Robot\lerobot\examples\tutorial\pi05\using_pi05_example.py", line 28, in
preprocess, postprocess = make_pre_post_processors(
File "D:\new_projects\Robot\lerobot\src\lerobot\policies\factory.py", line 232, in make_pre_post_processors
PolicyProcessorPipeline.from_pretrained(
File "D:\new_projects\Robot\lerobot\src\lerobot\processor\pipeline.py", line 573, in from_pretrained
steps, validated_overrides = cls._build_steps_with_overrides(
File "D:\new_projects\Robot\lerobot\src\lerobot\processor\pipeline.py", line 778, in _build_steps_with_overrides
step_instance = cls._instantiate_step(step_entry, step_class, step_key, overrides)
File "D:\new_projects\Robot\lerobot\src\lerobot\processor\pipeline.py", line 909, in _instantiate_step
raise ValueError(
ValueError: Failed to instantiate processor step 'tokenizer_processor' with config: {'max_length': 200, 'task_key': 'task', 'padding_side': 'right', 'padding': 'max_length', 'truncation': True, 'tokenizer_name': 'google/paligemma-3b-pt-224'}. Error: (MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/google/paligemma-3b-pt-224/tree/main/additional_chat_templates?recursive=False&expand=False (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000002464D4B5C00>, 'Connection to
huggingface.co timed out. (connect timeout=None)'))"), '(Request ID: 67e3fed6-6ea2-4749-be92-f9ffd3cfeec0)')`