Hi Marios,

Thanks for sharing, it is great to hear that we are going to have more GPUs!

I think they are all good GPUs. I have used some older versions like A100 and A6000 (not Ada) but not these new versions.

Just a quick note regarding NVIDIA 6000 Ada just in case if it is helpful. It doesn’t support NVLink, meaning GPU memory cannot be pooled across multiple cards. This could limit the ability to handle large model training or inference. For multi-GPU setups, its advantage might be less significant. (Btw it is really weird that the new 6000 Ada canceled NVLink support…)

Best,

Zhiheng

From: Marios Avgeris <m.avgeris@uva.nl>
Date: Friday, December 20, 2024 at 14:22
To: prognets@list.uva.nl <prognets@list.uva.nl>
Subject: [Prognets] Purchase of New Graphics Cards

Hi team,

I hope you are all doing well and preparing for your winter break.

One last request before we say goodbye for a while; We are planning to order some graphics cards of the following types:

1. NVIDIA RTX 6000 Ada https://www.nvidia.com/en-us/design-visualization/rtx-6000/

2. NVIDIA A40 https://www.nvidia.com/en-us/data-center/a40/

3. NVIDIA H100 Tensor Core GPU https://www.nvidia.com/en-us/data-center/h100/

Has anyone worked with any of them (or similar)? If so, do you have any feedback?

Do you have any objections/other suggestions?

We would greatly appreciate any comments before the end of the day, as we are planning to finalize the equipment list before we leave.

Best,

Marios