[email protected]

How-to · Local AI for Business

Configure Gigabyte AI TOP ATOM for business

Editorial note: Versions, commands and prices may change. Please verify critical steps independently before production use. This guide does not replace individual professional, legal or tax advice.

Move AI TOP ATOM from installation to production use? WZ-IT provides the GB10 class with Open WebUI, a local model, hardening, integration, and support as the AI Cube. Explore the AI Cube

Gigabyte AI TOP ATOM is a compact AI computer based on NVIDIA's GB10 Grace Blackwell Superchip. Its 128 GB of unified memory and up to 4 TB of NVMe storage provide a foundation for local inference, model testing, and development. Gigabyte also provides AI TOP software tools. Company-wide use still requires defined user, data, and operating paths.

Understand the hardware

Gigabyte states up to 1 PFLOP FP4, models up to 200 billion parameters, and ConnectX-7 for connecting two systems. The 20-core Arm processor and Blackwell GPU use the same memory, so software and containers need ARM64 support.

Since October 2026, Gigabyte has been one of the OEM partners through which NVIDIA sells a GB10 variant with 64 GB of unified memory (NVIDIA blog). This variant is available from 23 October 2026 and targets models up to about 100 billion parameters. Whether a specific AI TOP ATOM model has 64 GB or 128 GB depends on the SKU; this article refers to the 128 GB version.

Maximum parameter count does not equal a sensible business model. Quantisation, context, KV cache, and concurrent chats materially affect memory use and throughput.

Business setup

A controlled setup documents firmware and drivers; configures named administrators, SSH, DNS, TLS, and firewall rules; selects a runtime and model for the expected concurrency; deploys Open WebUI with users and model permissions; covers models, chat data, knowledge, and configuration in backups; and defines monitoring, updates, restore, and support access.

AI TOP software and Open WebUI

Gigabyte's tools primarily support development and local AI workflows. Employees usually benefit from one browser-based interface. Open WebUI provides chat, model selection, personal and shared knowledge spaces, and user management.

The platform can offer local and approved external models together. Technical and organisational rules must define which data may reach which endpoint.

When AI TOP ATOM is a good fit

AI TOP ATOM is suitable where Gigabyte is the preferred supplier or the accompanying AI TOP tools add value to development workflows. Open WebUI still provides the central interface for later use by business departments; developer tools and an employee platform serve different needs.

SSD configuration, target models, and concurrency should be defined before ordering. An internal knowledge assistant for one team has different priorities from a development group maintaining several model artefacts. Because the common GB10 foundation offers similar core performance, availability, storage, support, and integration often matter more than theoretical compute.

Complete entry and later scaling

The AI Cube adds Open WebUI, model runtime, an agreed local model, hardening, functional testing, initial setup, and support. Automated RAG sources, interfaces, and MCP servers are added for the use case.

With growing use, another AI Cube can serve independent requests. Distributed inference is possible for larger individual models but is not automatically faster. The ConnectX-7 guide explains both paths.

Sources

Rather have it operated?

You'd rather not run Local AI for Business yourself? WZ-IT handles setup, operations and maintenance - privacy-focused from Germany.

Frequently Asked Questions

Answers to the most important questions

Knowledge

More on Local AI for Business

All Local AI for Business articles

Companies worldwide trust WZ-IT

  • Stadtwerke Brühl
  • DGHO e.V.
  • ABCO Water Systems
  • Golem.de
  • EVADXB
  • nextGYM
  • AInergy
  • ml&s
  • Odiseo Solutions
  • Annota
  • ARGE
  • SweetConnect GmbH
  • Aphy AG
  • CORGOS
  • Rekorder
  • SolidProof
  • Yonju
  • Keymate
  • Paritel
  • Mr. Clipart
  • Millenium
  • Negosh
  • Führerscheinmacher
  • Boese VA
Read client reviews

Enquiry

Assess local AI for your use case

Start with the AI Cube or have us assess a custom AI platform, knowledge connection, or integration.

  • Straight with Timo and Robin - no sales team, no pitch
  • An honest take, including when we are not the right fit
  • Concrete next steps for infrastructure, software or AI

No risk: worst case, you leave with a clearer understanding of your project than before.

WZ-IT's advice on our Azure migration was technically sound and completely non-binding right from the intro call - we took away a great deal.
Jakob ÖschlbergerInno7 GmbH
Timo and Robin, founders of WZ-IT

Assess local AI for your use case

WZ-IT's advice on our Azure migration was technically sound and completely non-binding right from the intro call - we took away a great deal.
Jakob ÖschlbergerInno7 GmbH