Framework desktop doesn't have it's gpu noticed

[ColtonIdle]

System details

Framework desktop 128GB

What's wrong?

I got a framework desktop and tried to installed LM studio so i can do some local llm stuff. LM studio says no gpu installed. if i install fedora its not an issue. I know @dhh uses framework desktop... should this work out of the box or are there extra install steps? sorry for noob

[dhh]

Maybe @eclecticc can help us with what the latest state of this is from the AMD side?

[phren0logy]

I am also seeing this issue, despite installing the packages recommended by Framework here:

https://guides.frame.work/Guide/Arch+Linux+on+the+Framework+Desktop/416?lang=en

Referring to this part of Step 15 specifically:
pacman -S mesa xf86-video-amdgpu vulkan-radeon libva-mesa-driver mesa-vdpau xorg-xrandr

Steam also shows no GPU, so it's not just LM Studio. I did not have any luck with the Vulcan Caps Viewer in AUR, either (it installs, but does not launch).

[phren0logy]

Update: Steam "System Report" does not show any video devices. Steam "System Information" shows the iGPU correctly. Starting a game (Civ 7) also shows the iGPU.

LM Studio still shows "Error surveying hardware" in Settings -> Runtimes. Only CPU inference engine is available (no vulkan, to ROCm).

[ColtonIdle]

should btop show the gpu? btop does not show it for me

[ColtonIdle]

also appreciate you chiming in. i thought i was the only one and i was going crazy lol

[Patrice44]

I have used the following commands to run LM Stidio on my Framework Desktop

 PC: Desktop (AMD Ryzen AI Max 300 Series) (A6)
├: AMD RYZEN AI MAX+ 395 (32) @ 5.19 GHz
│ ├: AMD Radeon 8060S Graphics [Integrated]
│ ├󱄄: 1680x1050 in 23", 60 Hz [External]
│ ├󰋊: 75.02 GiB / 1.82 TiB (4%) - btrfs

 OS: Omarchy 3.1.7
│ ├󰘬: master
│ ├: Linux 6.17.7-arch1-2
│ ├: Hyprland 0.52.1 (Wayland)
│ ├: alacritty 0.16.1
│ ├󰏖: 1021 (pacman), 11 (snap)
│ ├󰸌: Tokyo Night ●●●●●●●●
└ └: alacritty (9pt)

• sudo pacman -S mesa xf86-video-amdgpu vulkan-radeon libva-mesa-driver mesa-vdpau xorg-xrandr

• lspci -k -d ::03xx

c2:00.0 Display controller: Advanced Micro Devices, Inc. [AMD/ATI] Strix Halo [Radeon Graphics / Radeon 8050S Graphics / Radeon 8060S Graphics] (rev c1)
    Subsystem: Framework Computer Inc. Device 000a
    Kernel driver in use: amdgpu
    Kernel modules: amdgpu

• sudo pacman -Syu

• sudo pacman -Ss rocm

• sudo pacman -S rocm-hip-sdk

• cat .bashrc

export PATH=$PATH:/snap/bin
export PATH="$PATH:/home/patrice/.lmstudio/bin"
export PATH="$PATH:/opt/rocm/bin"

• source .bashrc

• rocminfo

.....
*******
Agent 1
*******
  Name:                    AMD RYZEN AI MAX+ 395 w/ Radeon 8060S
  Uuid:                    CPU-XX
  Marketing Name:          AMD RYZEN AI MAX+ 395 w/ Radeon 8060S
  Vendor Name:             CPU
.....
  *******
Agent 2
*******
  Name:                    gfx1151
  Uuid:                    GPU-XX
  Marketing Name:          Radeon 8060S Graphics
  Vendor Name:             AMD
.....

• rocm-smi

 Exception caught: map::at
 ======================================== ROCm System Management Interface ========================================
 ================================================== Concise Info ==================================================
 Device  Node  IDs              Temp    Power     Partitions          SCLK  MCLK  Fan  Perf  PwrCap  VRAM%  GPU%
               (DID,     GUID)  (Edge)  (Socket)  (Mem, Compute, ID)
 ==================================================================================================================
 0       1     0x1586,   22867  48.0°C  13.053W   N/A, N/A, 0         N/A   N/A   0%   auto  N/A     4%     0%
 ==================================================================================================================
 ============================================== End of ROCm SMI Log ===============================================

• Install LM Studio

• Configure LM Studio / Runtime Download and Enable "ROCm llama.cpp (Linux)"

• Select a model to configure it

• Run LM studio with the following environment variable

• HSA_OVERRIDE_GFX_VERSION=11.0.2 /usr/bin/lmstudio

( to workaround the following error
rocBLAS error: Cannot read /home/userx/.lmstudio/extensions/backends/vendor/linux-llama-rocm-vendor-v3/rocblas/library/TensileLibrary.dat: Illegal seek for GPU arch : gfx1151 )

[ColtonIdle]

let me give this a shot. thanks for the details. i do find some of the changes needed to lm studio a bit interesting. i can use fedora with lm studio and gpu support with no additional config. so i would think this is something on the OS level, and not the application?