Building a local AI server for Qwen3 30B with Q8 is this hardware a good fit?
|
Hi everyone, I'm planning to build a local AI server for business automation and would appreciate some feedback on the hardware before I buy the remaining parts. The workflow will use n8n for orchestration, Ollama + Qwen3-30B-A3B (Q8) for local inference, PostgreSQL + pgvector for RAG, and maybe later Open WebUI as the interface. A typical use case would be:
I already own 2× RTX 3090 (24 GB each, 48 GB total VRAM). Planned hardware:
From what I've read, Qwen3-30B-A3B (Q8) should require around 33 GB VRAM, so it should fit on the dual 3090 setup. My questions:
Thanks for your feedback! submitted by /u/Syosse-CH |