Programming

19887 readers

130 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Follow the programming.dev instance rules
Keep content related to programming in some way
If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev

founded 2 years ago

MODERATORS

snowe@programming.dev

Ategon@programming.dev

MaungaHikoi@lemmy.nz

Can anybody explain why CUDA and Rocm are necessary and why OpenCL isn't the solution? (programming.dev)

submitted 4 weeks ago by onlinepersona@programming.dev to c/programming@programming.dev

18 comments fedilink hide all child comments

I've read multiple times that CUDA dominates, mostly because NVIDIA dominates. Rocm is the AMD equivalent, but OpenCL also exists. From my understanding, these are technologies used to program graphics cards - always thought that shaders were used for that.

There is a huge gap in my knowledge and understanding about this, so I'd appreciate somebody laying this out for me. I could ask an LLM and be misguided, but I'd rather not 🤣

Anti Commercial-AI license

you are viewing a single comment's thread
view the rest of the comments

[–] moonpiedumplings@programming.dev 4 points 4 weeks ago* (last edited 4 weeks ago) (1 children)

AFIK it’s only NVIDIA that allows containers shared access to a GPU on the host.

This cannot be right. I'm pretty sure that it is possible to run OpenCL applications in containers that are sharing a GPU.

I should test this if I have time. My plan was to use a distrobox container since that shares the GPU by default and run something like lc0 to see if opencl acceleration works.

Now where is my remindme bot? (I won't have time).

[–] skip0110@lemm.ee 2 points 4 weeks ago

You really piqued my interest. I use docker/podman.

W/ an AMD graphics card, eglinfo on the host shows the card is AMD Radeon and driver is matching that.

In the container, without --gpus=all, it shows the card is unknown and the driver is "swrast" (so just CPU fallback).

To make --gpus=all work, it gives the error

docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]

I was doing a bad job searching before. I found that AMD can share the GPU, it just works a little differently in terms of how to launch the container. https://rocm.docs.amd.com/projects/install-on-linux/en/latest/install/amdgpu-install.html#amdgpu-install-dkms

But sadly my AMD GPU is too old/junk to have current driver support.

Anyways, appreciate the reply! Now I can mod my code to run on cheaper cloud instances.

(Note I'm an OpenGL/3D app developer, but probably OpenCL works about the same architecturally)