Want to run a language model on a dedicated GPU without handling drivers, vLLM and monitoring yourself? The Managed GPU Server is located in a German data centre, with 24 GB of VRAM for €699 or 96 GB of VRAM for €1,799 net per month plus setup, including model, vLLM, Open WebUI and operations. Book an initial consultation
Hetzner rebuilt its GPU range in autumn 2026: the GEX45 arrived on 1 September, the GEX63 on 6 October, and the GEX44 can no longer be ordered. Many comparisons online therefore list models and prices that no longer apply.
This article puts every orderable Hetzner GPU server into one table: GPU, VRAM, CPU, RAM, storage, location, net and gross price, setup fee, term and cost per GB of VRAM. It then covers which LLM sizes fit on 24 and 96 GB, what self-managed operation involves and when an API is the better choice. All figures as of 13 October 2026.
Table of contents
- The Hetzner GPU servers at a glance
- Prices and cost per GB of VRAM
- Hourly price and billing
- Which LLMs fit on 24 and 96 GB
- GEX63 or GEX131
- Location: Germany or Helsinki
- What a self-managed GPU server needs
- Self-managed or Managed GPU Server
- When an API or GPU cloud is the better fit
- Common misconceptions
- Status and methodology
- Our approach at WZ-IT
- Further guides
The Hetzner GPU servers at a glance
Hetzner offers GPUs as dedicated root servers in its GEX line. The Hetzner documentation lists five current server types across three models:
| Model | GPU | VRAM | Bandwidth | CPU | RAM | NVMe | Location |
|---|---|---|---|---|---|---|---|
| GEX45 | RTX PRO 4000 Blackwell SFF | 24 GB GDDR7 ECC | 432 GB/s | Intel Core i5-13500 (14 cores, 20 threads) | 64 GB DDR4 | 2 × 512 GB | HEL1 |
| GEX63 | RTX PRO 6000 Blackwell Max-Q | 96 GB GDDR7 ECC | 1,792 GB/s | Intel Core Ultra 7 265 (20 cores) | 128 GB DDR5 | 2 × 1.92 TB | HEL1 |
| GEX131-1 | RTX PRO 6000 Blackwell Max-Q | 96 GB GDDR7 ECC | 1,792 GB/s | Intel Xeon Gold 5412U (24 cores, 48 threads) | 256 GB DDR5 ECC | 2 × 960 GB | FSN1, HEL1 |
| GEX131-2 | RTX PRO 6000 Blackwell Max-Q | 96 GB GDDR7 ECC | 1,792 GB/s | Intel Xeon Gold 5412U | 512 GB DDR5 ECC | 2 × 1.92 TB | FSN1, HEL1 |
| GEX131-3 | RTX PRO 6000 Blackwell Max-Q | 96 GB GDDR7 ECC | 1,792 GB/s | Intel Xeon Gold 5412U | 768 GB DDR5 ECC | 4 × 3.84 TB | FSN1, HEL1 |
GPU data comes from NVIDIA (RTX PRO 4000 Blackwell SFF, RTX PRO 6000 Blackwell Max-Q), server data from the product pages and the configurator.
All models share these points:
- One GPU per server. According to the documentation, additional graphics cards cannot be installed.
- Network: 1 Gbit/s port with guaranteed bandwidth and unlimited traffic. Only the GEX131 can be equipped with a 10 Gbit uplink for €43 net per month; traffic above 20 TB is then charged.
- Access: full root access, one IPv4 address, an IPv6 subnet, rescue system and images for Debian and Ubuntu, among others.
- Term: no minimum contract term, immediate cancellation.
No longer in the range are the GEX44 with an RTX 4000 SFF Ada (20 GB GDDR6), whose product page redirects to the GEX45 and whose order page lists it as currently not available, and the GEX130 with an RTX 6000 Ada (48 GB). Hetzner does not list data centre GPUs such as the H100 or H200.
Prices and cost per GB of VRAM
All prices include one IPv4 address (€1.70 net per month), as of 13 October 2026. Hetzner's English press releases state net prices ("All prices without VAT"), the German ones gross prices with 19% VAT; the website adds VAT depending on the selected country.
| Model | Month net | Month gross (19% VAT) | Setup net | € per GB VRAM per month | € per GB VRAM over 12 months incl. setup |
|---|---|---|---|---|---|
| GEX45 | €214.00 | €254.66 | €209 | €8.92 | €9.64 |
| GEX63 | €999.00 | €1,188.81 | €999 | €10.41 | €11.27 |
| GEX131-1 | €1,499.00 | €1,783.81 | €1,499 | €15.61 | €16.92 |
| GEX131-2 | €2,099.00 | €2,497.81 | €2,099 | €21.86 | €23.69 |
| GEX131-3 | €2,699.00 | €3,211.81 | €2,699 | €28.11 | €30.46 |
The GEX45 and GEX63 prices match the press releases (GEX45: €214.00, GEX63: €999.00), the GEX131 prices match the price data on the product page.
Three points stand out:
- The GEX45 has the cheapest GB of VRAM, but 24 GB limits model size.
- The GEX63 delivers the same 96 GB GPU as the GEX131-1 for €500 less per month, a third below the GEX131-1.
- GEX131-2 and -3 cost more without offering more VRAM. The premium pays for RAM and storage.
Prices are rising. The GEX131 launched in December 2025 at €889 net without a setup fee (since 16 December 2025: €159). In the price list for the 15 June 2026 adjustment, the GEX131-1 was listed at €1,197.30 excluding IPv4 with a €599 setup fee. On 13 October 2026 it is €1,499 and €1,499. The GEX44 cost €184 net at its launch in March 2024.
Hourly price and billing
Besides the monthly price, Hetzner lists an hourly price. According to the billing documentation, usage is billed by the hour, partial hours are rounded up, and the total never exceeds the monthly price.
| Model | Hourly price net | Monthly price reached after | One week (168 h) incl. setup |
|---|---|---|---|
| GEX45 | €0.3429 | 624 hours | €266.61 |
| GEX63 | €1.6009 | 624 hours | €1,267.95 |
| GEX131-1 | €2.4022 | 624 hours | €1,902.57 |
| GEX131-2 | €3.3638 | 624 hours | €2,664.12 |
| GEX131-3 | €4.3253 | 624 hours | €3,425.65 |
For planning this means:
- From about 26 days of runtime, the full monthly price applies.
- Switching off saves nothing. A server is billed as long as it exists in the account. To stop paying, you have to cancel it.
- The setup fee applies per order. For short projects it makes up most of the cost, about 79% of a week on the GEX63.
Which LLMs fit on 24 and 96 GB
The calculation follows the article Sizing GPU and VRAM for LLMs: weights need about 2 GB per billion parameters in FP16, about 1 GB in FP8 and about 0.5 GB with 4-bit quantisation. vLLM uses 92% of GPU memory by default (--gpu-memory-utilization), so about 22 GB on 24 GB and about 88 GB on 96 GB.
The table shows how much of this budget remains after the weights. A few GB of that go to activations and CUDA graphs; the rest is available for the KV cache, i.e. context and concurrent requests.
| Class | Example (parameters) | Weights in GB, FP16 / FP8 / 4-bit | Remaining on 24 GB, FP16 / FP8 / 4-bit | Remaining on 96 GB, FP16 / FP8 / 4-bit |
|---|---|---|---|---|
| 8B | Qwen3-8B (8.2 bn) | 16 / 8 / 4 | 6 / 14 / 18 | 72 / 80 / 84 |
| 14B | Qwen3-14B (14.8 bn) | 30 / 15 / 7 | too large / 7 / 15 | 58 / 73 / 81 |
| 32B | Qwen3-32B (32.8 bn) | 66 / 33 / 16 | too large / too large / 6 | 22 / 55 / 72 |
| 70B | Llama 3.3 70B (70.6 bn) | 141 / 71 / 35 | too large | too large / 17 / 53 |
| 120B | gpt-oss-120b (117 bn) | 234 / 117 / 58 | too large | too large / too large / 30 |
How to read the figures:
- 24 GB (GEX45) handles 8B and 14B models with headroom for context. A 32B model only fits in 4-bit and leaves about 6 GB, so little room for parallel sessions.
- 96 GB (GEX63, GEX131) handles 32B models in FP8 with plenty of context and 70B models in 4-bit. According to its model card, gpt-oss-120b runs on a single 80 GB GPU in its MXFP4 quantisation.
- 4-bit files are larger in practice than the rule of thumb: a 70B model takes about 40 to 45 GB instead of 35 GB.
- Architecture matters for the cache. Qwen3-32B needs 256 KiB per token (8 GiB for one session with 32,768 tokens), the hybrid Qwen3.8-27B only 64 KiB. On 24 GB, Qwen3.8-27B in 4-bit leaves room for about 80,000 tokens of cache, a model with 256 KiB per token in the same space for about 20,000.
Beyond 96 GB, Hetzner has no single-server option. A 120B model in FP8 takes about 117 to 125 GB (for example Qwen3.5-122B-A10B-FP8) and needs two GPUs, as shown in the field report Qwen3.5-122B on two RTX PRO 6000. Spreading a model across two Hetzner servers is only possible over the network; the options are covered in Multi-GPU inference without NVLink.
Which configuration fits a specific use case depends on context length and concurrent requests. Formulas and worked examples are in the article on VRAM sizing, formats in the article on LLM quantization.
GEX63 or GEX131
Both servers have the same GPU. They differ in platform, location and price:
| GEX63 | GEX131-1 | |
|---|---|---|
| GPU | RTX PRO 6000 Blackwell Max-Q, 96 GB | identical |
| CPU | Core Ultra 7 265, 8 performance and 12 efficiency cores | Xeon Gold 5412U, 24 cores, 48 threads |
| RAM | 128 GB DDR5 UDIMM, without ECC according to the configurator | 256 GB DDR5 ECC reg., up to 768 GB as -2/-3 |
| NVMe | 2 × 1.92 TB | 2 × 960 GB, up to 4 × 3.84 TB as -3 |
| Network | 1 Gbit/s | 1 Gbit/s, optional 10 Gbit/s |
| Location | Helsinki | Falkenstein or Helsinki |
| Provisioning according to Hetzner | usually within a few minutes | usually within 10 to 12 workdays |
| Price net | €999 + €999 setup | €1,499 + €1,499 setup |
The provisioning times come from the order processing overview, last updated on 6 October 2026.
For inference with a single model, the GEX63 is the cheaper choice, because the GPU determines the speed. The GEX131 pays off if one of these applies: German location, ECC system memory, more than 128 GB of RAM (for example for data preparation or many containers next to the model), more local storage or 10 Gbit/s.
Location: Germany or Helsinki
Hetzner operates its own ISO 27001-certified data centre parks in Nuremberg and Falkenstein (Germany) and Helsinki (Finland). For GPU servers, the location is tied to the model:
| VRAM | in Germany (FSN1) | only in Finland (HEL1) |
|---|---|---|
| 24 GB | not offered | GEX45 |
| 96 GB | GEX131-1/-2/-3 from €1,499 net | GEX63 for €999 net |
Under data protection law, Helsinki is not a third country. Finland is an EU member state, and under Art. 1(3) GDPR the free movement of personal data within the Union may be neither restricted nor prohibited for data protection reasons. A server in HEL1 is therefore not at a disadvantage compared with one in Falkenstein.
A German location is still often a requirement, for example in customer contracts, tenders or internal policies. In that case Hetzner offers only the GEX131 for 96 GB and currently no model for 24 GB. WZ-IT's Managed GPU Server is located in a German data centre in both sizes.
The location alone does not define the data path. Model downloads, external APIs, telemetry and backup targets are separate data paths that also need to be defined.
What a self-managed GPU server needs
Hetzner provides hardware, network and images. The GPU server documentation states that the customer is responsible for all normal system administration tasks, explicitly software, monitoring, RAID configuration, backups and security. For a production LLM server, these are the building blocks:
| Building block | What needs doing | Note |
|---|---|---|
| Operating system | Install Debian or Ubuntu, set up software RAID across the NVMe drives | RAID configuration is the customer's job according to Hetzner |
| NVIDIA driver | Driver with open GPU kernel modules | The proprietary modules are unsupported on Blackwell |
| CUDA | Toolkit and container runtime | Blackwell support from CUDA 12.8, Linux driver 570.26 or later |
| Inference server | vLLM for an OpenAI-compatible API with several users, Ollama mainly for testing | Differences in vLLM vs. Ollama |
| User interface | Open WebUI or your own application | User management and database belong in the backup |
| Access protection | Reverse proxy with TLS and authentication | According to the documentation, --api-key in vLLM does not protect all endpoints; Ollama binds to 127.0.0.1:11434 by default |
| Firewall | Robot firewall (stateless, free) plus host firewall | Expose only the proxy port |
| Monitoring | GPU metrics via the DCGM Exporter, vLLM metrics via /metrics, alerting |
Someone has to respond to alerts, including at night |
| Updates | OS, driver, CUDA, vLLM, Open WebUI | Track security advisories, see Ollama vulnerability CVE-2026-7482 |
| Backup | Configuration, Open WebUI database, RAG data to an external target such as a Storage Box | Model weights can be downloaded again, chats and documents cannot |
The one-time setup is the smaller part. What remains is ongoing: updates, assessing vulnerabilities, model changes and on-call duty for incidents.
Self-managed or Managed GPU Server
A self-managed GEX is the cheapest way to get a dedicated GPU. WZ-IT's Managed GPU Server uses the same GPU models and includes operations. The comparison in figures, all prices net:
| Hetzner GEX, self-managed | WZ-IT Managed GPU Server | |
|---|---|---|
| 24 GB VRAM | GEX45: €214 per month + €209 setup | Managed GPU Server 24: €699 per month + €499 setup |
| 96 GB VRAM | GEX63: €999 + €999 (Helsinki), GEX131-1: €1,499 + €1,499 (Falkenstein or Helsinki) | Managed GPU Server 96: €1,799 + €999 |
| GPU | RTX PRO 4000 Blackwell SFF or RTX PRO 6000 Blackwell Max-Q | RTX PRO 4000 Blackwell SFF or RTX PRO 6000 Blackwell Max-Q |
| Location | 24 GB only in Helsinki, 96 GB in Germany only as GEX131 | Data centre in Germany |
| Term | no minimum term | cancellable monthly |
| First year incl. setup | GEX45 €2,777, GEX63 €12,987, GEX131-1 €19,487 | €8,887 (24 GB), €22,587 (96 GB) |
| € per GB VRAM per month | €8.92 / €10.41 / €15.61 | €29.13 (24 GB) / €18.74 (96 GB) |
| Driver, CUDA, operating system | your team | WZ-IT |
| Model, vLLM, Open WebUI | set up yourself | one agreed model with vLLM and Open WebUI set up |
| Monitoring | build it yourself | proactive 24/7 monitoring of host, GPU, vLLM and Open WebUI |
| Updates and vulnerabilities | assess and apply yourself | OS, driver, vLLM and Open WebUI with CVE assessment |
| Incidents | your team, including nights and weekends | incident handling according to the agreed service level |
| More than one GPU | not possible | 2, 3 or 4 × RTX PRO 6000 on request |
Self-managed fits if your team has Linux, NVIDIA and vLLM skills and someone can cover on-call duty. A GEX is then considerably cheaper.
Managed fits if nobody on your team should respond to alerts at night, if you need 24 GB in a German data centre, or if operations and changes must be documented. Additional models, RAG, SSO and high availability are added according to scope.
Already running a GEX? We also take over the operation of existing AI servers at the customer's hosting provider after a technical review, see AI server maintenance and operations. The price depends on configuration and scope.
When an API or GPU cloud is the better fit
A dedicated server pays off with continuous use. Other load profiles have better options:
| Situation | Suitable option |
|---|---|
| Trying out a model, prototype, few requests | Hetzner Inference API or a model API |
| Batch jobs over a few hours or days per month | hourly GPU cloud, because every GEX order triggers the setup fee |
| Fluctuating load, data may go to a European provider | European LLM API |
| Daily use by a team, data stays on your own server | dedicated GPU server, self-managed or managed |
| Models above 96 GB or several large models in parallel | Server with several GPUs, such as the Managed GPU Server with 2 to 4 GPUs |
The Hetzner Inference API is an experimental service with an OpenAI-compatible interface. As of October 2026 it offers Qwen3.6-35B-A3B-FP8 and Qwen3.8-27B, each with a context of 262,144 tokens. It is free of charge while it remains experimental and limited to 10 requests and 4 million input and 100,000 output tokens per minute and API key. According to the documentation, Hetzner does not store the content of requests and responses, but gives no guarantee for performance and availability and advises against production use. It is a good starting point for a first test with open-weight models, not for a production service.
A decision guide between model API and own inference is in the article Cloud AI vs. self-hosted.
Common misconceptions
"More VRAM makes the model faster." VRAM size determines whether model and KV cache fit on the card and how many requests run in parallel. According to NVIDIA, token generation is mostly limited by memory bandwidth. The RTX PRO 6000 is faster than the RTX PRO 4000 because its 1,792 GB/s is more than four times the bandwidth, not because of the 96 GB.
"Max-Q means throttled and unsuitable for LLMs." The Max-Q edition is designed for 300 W instead of 600 W. According to NVIDIA, its theoretical peak AI performance is 3,511 instead of 4,000 AI TOPS, about 12% below the Workstation Edition. Memory and bandwidth are identical: 96 GB GDDR7 with ECC and 1,792 GB/s.
"The GEX131 is faster than the GEX63 because it costs more." Both have the same GPU. The premium pays for CPU, ECC memory, storage, network option and the Falkenstein location.
"A mixture-of-experts model only needs memory for its active parameters." With MoE models, all parameters must be loaded. Qwen3.6-35B-A3B computes with about 3 billion active parameters but occupies memory for 36 billion.
"Hetzner servers are located in Germany." The GEX45 and GEX63 are only available in Helsinki. Only the GEX131 can be ordered in Falkenstein.
"Switching off saves money." Hetzner bills a server as long as it exists in the account. Costs only end with cancellation, and every new order triggers the setup fee again.
"With --api-key, vLLM is secured." According to the vLLM documentation, some endpoints remain reachable without authentication even with an API key. A reverse proxy that only exposes the required endpoints is recommended.
Status and methodology
- Data collected: 13 October 2026.
- Hetzner data: product pages and configurator for the GEX45, GEX63 and GEX131, the price data used by the website, press releases and the documentation on GPU servers, provisioning times, billing and price adjustment.
- GPU data: NVIDIA product pages for the RTX PRO 4000 Blackwell SFF, RTX PRO 6000 Blackwell Max-Q and RTX PRO 6000 Blackwell Workstation Edition.
- Model data: parameter counts from the Hugging Face model cards.
- Prices: net including one IPv4 address (€1.70). Gross = net × 1.19 (German VAT). Hourly price = server plus IPv4.
- € per GB VRAM per month = net monthly price ÷ VRAM in GB.
- € per GB VRAM over 12 months = (12 × monthly price + setup) ÷ 12 ÷ VRAM.
- Monthly threshold = monthly price ÷ hourly price.
- LLM table: weights = parameters × 2 bytes (FP16), × 1 byte (FP8), × 0.5 bytes (4-bit). Remaining = vLLM budget (0.92 × VRAM, i.e. 22 GB or 88 GB) minus weights, rounded to whole GB.
- WZ-IT prices: net excluding VAT according to the Managed GPU Server offer page.
Prices and availability change; the provider's order page is authoritative. Tables and figures may be reused with attribution and a link to this article.
Our approach at WZ-IT
We provide dedicated GPU servers with operations and look after existing AI servers.
- Assess the workload: check model, quantisation, context, concurrent use and other compute loads against 24 or 96 GB of GPU memory.
- Managed GPU Server: Managed GPU Server 24 with an RTX PRO 4000 Blackwell SFF for €699 net per month plus €499 setup, Managed GPU Server 96 with an RTX PRO 6000 Blackwell Max-Q for €1,799 plus €999, both cancellable monthly and located in a German data centre.
- Included: one agreed model with vLLM, Open WebUI, proactive 24/7 monitoring, maintenance of operating system, drivers, vLLM and Open WebUI with CVE assessment, incident handling according to the service level, documentation and a personal point of contact.
- More than 96 GB: servers with two, three or four RTX PRO 6000 Blackwell Max-Q (192, 288 or 384 GB), price on request.
- Existing server: operation of AI servers at the customer's hosting provider after a technical review via AI server maintenance and operations.
If a self-managed GEX or a model API is the better fit, we will tell you.
Further guides
- Sizing GPU and VRAM for LLMs - formula for weights, KV cache and overhead
- Multi-GPU inference without NVLink - tensor parallelism, pipeline parallelism or replicas
- vLLM with Qwen3.5-122B on two RTX PRO 6000 - field report for models above 96 GB
- Managed GPU Server 96 with RTX PRO 6000 Blackwell - the 96 GB configuration in detail
- vLLM, Ollama or llama.cpp - which inference software fits which use case
- European LLM APIs compared - when an API is enough instead of your own GPU
- Hetzner Cloud vs dedicated server - every type with price per vCPU and GB of RAM
- GPUs on Proxmox: passthrough and vGPU - virtualising a GPU server
- WZ-IT Hetzner expertise - operating servers in your Hetzner account
Planning to run your own language model and looking for the right GPU? We review model, context and number of users and propose the right path: self-managed server, Managed GPU Server or API. Book an initial consultation
Sources
- Hetzner: GPU server overview
- Hetzner: GEX45
- Hetzner: GEX63
- Hetzner: GEX131
- Hetzner Docs: GPU Server, possible configurations and add-ons
- Hetzner press release: GEX45 (1 September 2026)
- Hetzner press release: GEX63 (6 October 2026)
- Hetzner press release: GEX131 (11 December 2025)
- Hetzner press release: GEX44 (4 March 2024)
- Hetzner press release: GEX130 (24 September 2024)
- Hetzner Robot: GEX44 order page
- Hetzner Docs: Price adjustment 15 June 2026
- Hetzner Docs: Billing system
- Hetzner Docs: Order processing
- Hetzner Docs: Inference API
- Hetzner Docs: Robot firewall
- NVIDIA: RTX PRO 4000 Blackwell SFF Edition
- NVIDIA: RTX PRO 6000 Blackwell Max-Q Workstation Edition
- NVIDIA: RTX PRO 6000 Blackwell Workstation Edition
- NVIDIA Technical Blog: Mastering LLM Techniques, Inference Optimization
- NVIDIA Technical Blog: Open-Source GPU Kernel Modules
- NVIDIA: CUDA 12.8 Release Notes
- vLLM: Engine arguments
- vLLM: Security
- vLLM: Metrics
- Ollama: FAQ
- NVIDIA DCGM Exporter
- Hugging Face: Mixture of Experts Explained
- Hugging Face: gpt-oss-120b model card
- Regulation (EU) 2016/679 (GDPR)












