AI at 45W: Neuchips showcases energy-saving chips for LLMs

As global energy demand surges alongside AI growth, Neuchips is stepping up with energy-efficient solutions that deliver high performance while reducing power consumption.

The company will showcase its latest innovations at COMPUTEX 2025, including its Viper series AI accelerator cards, capable of running a 14-billion parameter model at just 45 watts — roughly the same power as a standard light bulb.

The announcement follows an International Energy Agency (IEA) report projecting that electricity demand from AI-powered data centers will more than quadruple by 2030. Neuchips CEO Ken Lau emphasised that power-efficient AI is now a necessity, not a luxury.

Neuchips’ hardware supports models like Mistral Small 3, Llama 3.3, and Gemma 3, offering offline LLM inference that enhances data privacy. Its solutions are compatible with both Intel and AMD CPUs , and run on Ubuntu and Windows.

The company is expanding its reach through several key partnerships. With Taiwan’s National Center for High-performance Computing (NCHC), Neuchips is delivering energy-efficient AI to the cloud while ensuring data security and cost efficiency.

Collaborating with MAPLE LEAF INFORMATION AND TECHNOLOGY and Vecow, the company offers compact AI systems that operate without requiring additional power infrastructure.

In partnership with GSH’s ShareGuru SQLPilot, Neuchips is showcasing advanced agentic AI applications for business intelligence and customer service. Additionally, through integration with myLLM’s myPDA platform, Neuchips is enabling hybrid cloud-edge AI deployments using its hardware.

With its efficient AI acceleration chips and strategic collaborations, Neuchips is advancing sustainable AI across edge and data center environments.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot !