openai_harmony.HarmonyError: error downloading or loading vocab file: failed to download or load

[lianxintao]

In an offline environment without a network, the following error will be reported：
File "/home/lianxintao/venv-gpt/lib/python3.12/site-packages/openai_harmony/init.py", line 689, in load_harmony_encoding
inner: _PyHarmonyEncoding = _load_harmony_encoding(name)
openai_harmony.HarmonyError: error downloading or loading vocab file: failed to download or load vocab file。

how can I slove this problem 。

[jamesljlster]

I'm not entirely sure if I did it correctly or not.
I found that a /tmp/tiktoken-rs-cache is created after running the load_harmony_encoding function.
After I uploaded and mounted the directory into the container, I can launch the model purely offline.

[lianxintao]

yes, you are right,.#41

[Redias]

I'm not entirely sure if I did it correctly or not. I found that a /tmp/tiktoken-rs-cache is created after running the load_harmony_encoding function. After I uploaded and mounted the directory into the container, I can launch the model purely offline.

I want to know which files you uploaded and mounted and where I can download them? I upload 2 files but error exists though. Thx!

ls -l /tmp/tiktoken-rs-cache/
total 5176
-rw-rw-r-- 1 1002 1002 1681126 Aug  8 02:26 cl100k_base.tiktoken
-rw-rw-r-- 1 1002 1002 3613922 Aug  8 02:25 o200k_base.tiktoken

[Gh0stWires]

I am also receiving this error but I am on an online environment. I have the library installed in a python virtual env thats running on a RPi connected to the network but I get this error

python -c "from openai_harmony import load_harmony_encoding, HarmonyEncodingName as N; load_harmony_encoding(N.HARMONY_GPT_OSS)"
Traceback (most recent call last):
File "", line 1, in
File "/home/gh0st/env/lib/python3.11/site-packages/openai_harmony/init.py", line 689, in load_harmony_encoding
inner: _PyHarmonyEncoding = _load_harmony_encoding(name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
openai_harmony.HarmonyError: error downloading or loading vocab file: failed to download or load vocab file

[Hexoplon]

When running on a corporate network with TLS decryption this error also occurs. Seems that the rust implementation does not respect the system trust store.

[jamesljlster]

I'm not entirely sure if I did it correctly or not. I found that a /tmp/tiktoken-rs-cache is created after running the load_harmony_encoding function. After I uploaded and mounted the directory into the container, I can launch the model purely offline.

I want to know which files you uploaded and mounted and where I can download them? I upload 2 files but error exists though. Thx!

ls -l /tmp/tiktoken-rs-cache/
total 5176
-rw-rw-r-- 1 1002 1002 1681126 Aug  8 02:26 cl100k_base.tiktoken
-rw-rw-r-- 1 1002 1002 3613922 Aug  8 02:25 o200k_base.tiktoken

Hi Red,

I uploaded the /tmp/tiktoken-rs-cache directory entirely without modifying the file names. Please give it a try.

I got this directory generated after executing the following command:

python -c "import openai_harmony; openai_harmony.load_harmony_encoding(openai_harmony.HarmonyEncodingName.HARMONY_GPT_OSS)"

[gaby]

Why is this library downloading files during runtime? This causes a lot of issues in local/offline environments.

@Redias @Gh0stWires @Hexoplon I was able to get it working by setting an ENV variable named TIKTOKEN_ENCODINGS_BASE pointing to the folder with the 2 encoding files.

You do have to download both files before hand and put them in a directory on your host. The files are:

• https://openaipublic.blob.core.windows.net/encodings/o200k_base.tiktoken
• https://openaipublic.blob.core.windows.net/encodings/cl100k_base.tiktoken

Related vllm-project/vllm#22525

[Redias]

I download the vocab file in this method.

TIKTOKEN_RS_CACHE_DIR=/vocab/download/path python -c 'from openai_harmony import load_harmony_encoding; load_harmony_encoding("HarmonyGptOss")'

ref: https://huggingface.co/openai/gpt-oss-120b/discussions/39#6892d6cc421a56a8deb417a7