I'm looking to update my AI training machine to something with ECC memory. I currently have:
Max power consumption (all time) is around 700W with both GPUs working. Memory utilization is maxed with the installed 128GB (but that is fine for my current workload), and CPU usage is around 75% utilization. I'll be selling this (minus the storage and GPUs to hopefully fund most of the new system.
---
I'm wanting either a tower server or a workstation that could be rack mounted in the future and has ECC memory that is relatively power efficient. I know the current GPUs will be a tight fit in the Lenovo P620, but that is probably more room than what I currently have in the Fractal North case. I will also be changing the GPUs for 1-2 slot workstation cards in the future, but not right away.
The Lenovo P620 seems to be affordable, covers my needs today, and has clear CPU and memory upgrade paths up to 64 cores and up to 1TB of RAM. My only real concern is the 1000W non-upgradable power supply, but I think that will help me keep power consumption in mind as this will be running 24/7 and I guess going from DDR5 to DDR4, but I don't think I can afford, or need, 128GB+ DDR5 ECC memory for this.
---
Is there something else that I should be considering?