Skip to content

nvidia nvml destory the start in docker without nvidia gpu #557

@2jiangjiang

Description

@2jiangjiang

I have no nvidia gpu and use docker to run exo

  1. docker run ubuntu
  2. git clone exo
  3. apt install build-essential python3 python3-venv python3-pip libgl1-mesa-dev libglib2.0-0
  4. source install.sh
  5. report the error

None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
Selected inference engine: None


/ _ \ / / _ \
| /> < (_) |
_
/_/____/

Detected system: Linux
Inference engine name after selection: tinygrad
Using inference engine: TinygradDynamicShardInferenceEngine with shard downloader: HFShardDownloader
[58906]
Chat interface started:

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/exo/.venv/bin/exo", line 5, in
from exo.main import run
File "/exo/exo/main.py", line 131, in
node = Node(
^^^^^
File "/exo/exo/orchestration/node.py", line 40, in init
self.device_capabilities = device_capabilities()
^^^^^^^^^^^^^^^^^^^^^
File "/exo/exo/topology/device_capabilities.py", line 151, in device_capabilities
return linux_device_capabilities()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/exo/exo/topology/device_capabilities.py", line 189, in linux_device_capabilities
pynvml.nvmlInit()
File "/exo/.venv/lib/python3.12/site-packages/pynvml.py", line 2220, in nvmlInit
nvmlInitWithFlags(0)
File "/exo/.venv/lib/python3.12/site-packages/pynvml.py", line 2203, in nvmlInitWithFlags
_LoadNvmlLibrary()
File "/exo/.venv/lib/python3.12/site-packages/pynvml.py", line 2250, in _LoadNvmlLibrary
_nvmlCheckReturn(NVML_ERROR_LIBRARY_NOT_FOUND)
File "/exo/.venv/lib/python3.12/site-packages/pynvml.py", line 979, in _nvmlCheckReturn
raise NVMLError(ret)
pynvml.NVMLError_LibraryNotFound: NVML Shared Library Not Found

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions