download panic #37
Description
Was trying out burn-lm for the first time and encountered a panic when trying to download the first model. Perhaps it is no longer available? Hard to tell.
✓ 'burn-lm' ready!
Welcome to Burn LM shell 🔥 (press CTRL+D to exit)
(vulkan-f16) burnlm> help
Usage: <COMMAND>
Commands:
backends List all available Burn backends
backend Change the Burn backend
chat Start a chat session with the chosen model
delete Delete downloaded models
dtype Change the Burn backend data type
download Download models
models List all available models and their download status
new Create a new inference server crate
run Run inference on chosen model in the terminal
server Run a simple OpenAI API compatible server
web Run inference in an Open WebUI client
help Print this message or the help of the given subcommand(s)
(vulkan-f16) burnlm> backends
╭──────────┬──────┬──────┬────────┬─────────────────────────┬───────────────────┬──────────────╮
│ WebGPU ┆ CUDA ┆ ROCm ┆ Vulkan ┆ ndarray ┆ Candle ┆ LibTorch │
╞══════════╪══════╪══════╪════════╪═════════════════════════╪═══════════════════╪══════════════╡
│ wgpu ┆ cuda ┆ rocm ┆ vulkan ┆ ndarray ┆ candle-accelerate ┆ libtorch-cpu │
│ wgpu-cpu ┆ ┆ ┆ ┆ ndarray-blas-accelerate ┆ candle-cpu ┆ libtorch │
│ ┆ ┆ ┆ ┆ ndarray-blas-netlib ┆ candle-cuda ┆ │
│ ┆ ┆ ┆ ┆ ndarray-blas-openblas ┆ ┆ │
╰──────────┴──────┴──────┴────────┴─────────────────────────┴───────────────────┴──────────────╯
(vulkan-f16) burnlm> models
╭─────────────────────────┬────────────┬─────────────────────╮
│ Available Models ┆ Downloaded ┆ Download Command │
╞═════════════════════════╪════════════╪═════════════════════╡
│ Llama 3 (8B Instruct) ┆ ❌ ┆ download llama3 │
├╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
│ Llama 3.1 (8B Instruct) ┆ ❌ ┆ download llama31 │
├╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
│ Llama 3.2 (1B Instruct) ┆ ❌ ┆ download llama32 │
├╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
│ Llama 3.2 (3B Instruct) ┆ ❌ ┆ download llama32-3b │
├╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
│ Parrot ┆ ✅ ┆ ─ │
├╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
│ TinyLlama ┆ ❌ ┆ download tinyllama │
╰─────────────────────────┴────────────┴─────────────────────╯
(vulkan-f16) burnlm> download llama3
[1/1] Downloading model: Llama 3 (8B Instruct)
Please wait...
model.mpk
▬ 198.39 MiB/14.96 GiB (1796.1s)
thread 'main' panicked at /home/aaelony/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rustyline-15.0.0/src/tty/unix.rs:1194:28:
fd != -1
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
thread 'main' panicked at library/core/src/panicking.rs:225:5:
panic in a function that cannot unwind
stack backtrace:
0: 0x5ade7245af42 - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::hf435e8e9347709a8
1: 0x5ade724875b3 - core::fmt::write::h0a51fad3804c5e7c
2: 0x5ade72456b23 - std::io::Write::write_fmt::h9759e4151bf4a45e
3: 0x5ade7245ad92 - std::sys::backtrace::BacktraceLock::print::h1ec5ce5bb8ee285e
4: 0x5ade7245c926 - std::panicking::default_hook::{{closure}}::h5ffefe997a3c75e4
5: 0x5ade7245c729 - std::panicking::default_hook::h820c77ba0601d6bb
6: 0x5ade7245d2b2 - std::panicking::rust_panic_with_hook::h8b29cbe181d50030
7: 0x5ade7245d036 - std::panicking::begin_panic_handler::{{closure}}::h9f5b6f6dc6fde83e
8: 0x5ade7245b449 - std::sys::backtrace::__rust_end_short_backtrace::hd7b0c344383b0b61
9: 0x5ade7245ccfd - __rustc[5224e6b81cd82a8f]::rust_begin_unwind
10: 0x5ade70eb3edd - core::panicking::panic_nounwind_fmt::hdcc420bb84b07b49
11: 0x5ade70eb3f72 - core::panicking::panic_nounwind::h681d69c581350003
12: 0x5ade70eb4096 - core::panicking::panic_cannot_unwind::h4320389209385803
13: 0x5ade70f352bd - rustyline::tty::unix::sigwinch_handler::h87a5cbdd3e2a3f7c
14: 0x793ed0a42520 - <unknown>
15: 0x793ed0b25e2e - epoll_wait
at ./misc/../sysdeps/unix/sysv/linux/epoll_wait.c:30:10
16: 0x5ade7230e12a - mio::poll::Poll::poll::hf88b91bf7d5951c9
17: 0x5ade722ee059 - tokio::runtime::io::driver::Driver::turn::h42b426c8438cb717
18: 0x5ade722fde95 - tokio::runtime::time::Driver::park_internal::h14e0ae56cbdc50f9
19: 0x5ade722fc111 - tokio::runtime::scheduler::current_thread::Context::park::ha023029380eb63d5
20: 0x5ade7214b50d - tokio::runtime::context::scoped::Scoped<T>::set::h7273a263728c7aed
21: 0x5ade7214d575 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::h89d04470e947d9a3
22: 0x5ade7214f56c - tokio::runtime::context::runtime::enter_runtime::h5a0a20513d76adf3
23: 0x5ade7214f87a - tokio::runtime::runtime::Runtime::block_on::h06f6e2435c7402e1
24: 0x5ade7214abf0 - burn_common::network::downloader::download_file_as_bytes::h6021d75fe23e7966
25: 0x5ade712e4ebd - burn_lm_llama::nn::llama::pretrained::downloader::<impl burn_lm_llama::nn::llama::pretrained::Pretrained>::download::h431a391506a7df98
26: 0x5ade712e60ec - burn_lm_llama::server::llama3::llama_downloader::ha601b873b1e19c5a
27: 0x5ade712e6557 - <burn_lm_llama::server::llama3::Llama3InstructServer<burn_fusion::backend::Fusion<burn_cubecl::backend::CubeBackend<cubecl_wgpu::runtime::WgpuRuntime,half::binary16::f16,i32,u32>>> as burn_lm_inference::server::InferenceServer>::downloader::downloader::hb464212f6996119c
28: 0x5ade70f10867 - burn_lm_cli::commands::download::handle::hb56aca347c641ae1
29: 0x5ade70ed88b2 - <F as cloop::shell::Handler<A,T>>::handle::he36f261185bef17b
30: 0x5ade70ed18ca - cloop::shell::Shell<T,I,P,H>::run::h7dd6864cdfb23173
31: 0x5ade70ede04f - burn_lm_cli::commands::shell::handle::h7d896f3a6426893b
32: 0x5ade70eba7a3 - burn_lm_cli::cli::run::hb8628813bfcc7f9a
33: 0x5ade70eb4a13 - std::sys::backtrace::__rust_begin_short_backtrace::h98a6c05f2503b67b
34: 0x5ade70eb496d - std::rt::lang_start::{{closure}}::h349539c242c985ea
35: 0x5ade7244c4c0 - std::rt::lang_start_internal::h31bbb7f936fd6b5d
36: 0x5ade70eb4b15 - main
37: 0x793ed0a29d90 - __libc_start_call_main
at ./csu/../sysdeps/nptl/libc_start_call_main.h:58:16
38: 0x793ed0a29e40 - __libc_start_main_impl
at ./csu/../csu/libc-start.c:392:3
39: 0x5ade70eb4895 - _start
40: 0x0 - <unknown>
thread caused non-unwinding panic. aborting.