Hi there, wonderful app!
I’ve been struggling to check the GPU allocated ram usage, I’m on Strix Halo therefore it’s specially important to me in order to check free GPU ram for AI workloads.
I must be missing it in the UI, can you help me?
Simoen.
Hi there, wonderful app!
I’ve been struggling to check the GPU allocated ram usage, I’m on Strix Halo therefore it’s specially important to me in order to check free GPU ram for AI workloads.
I must be missing it in the UI, can you help me?
Simoen.
@simmessa thanks for your feedback on monitoring GPU ram with AppControl. One thing we have wondered about is how to make AppControl better for people who are running AI software locally. Can you give some other comments/suggestions on how we can improve AppControl for people like yourself who work with AI often?
Hi, well, I guess that seeing GPU RAM usage per process would be very nice to have, because with AI workloads you tend to use various processes and I think it would be useful.
Also, on the windows task manager we can see the Shared GPU memory + total GPU memory (dedicated + shared), these are all things that should be monitored with AI workloads.
example:
On top of that, it might be useful to layer GPU graphs such as GPU temp, ram usage vs GPU usage, and the various GPU modes, again, like in the windows manager:
Cannot think of anything else at the moment but I’ll give you more insights if something new comes to mind.
I’d like to point out that there’s a fervent community of local AI workload runners on the dedicated subreddit found at Locallama:
https://www.reddit.com/r/LocalLLaMA/
I can’t remember if you ever posted about your app there but it might be a good place to get some constructive feedback and also make your app known.
Let me know if you want me to post about it there. I’d gladly do it.
Many thanks,
Simone.
I worry we will look spammy if we post there, but if you find AppControl genuinely useful for that community then we’d be grateful if you posted us there. @simmessa Thank you for considering doing that!
I will post your details to our team and we’ll continue to work to improve. Also, you can send them to this thread to give feedback too and we’ll respond to them.