PrivateGPT
PrivateGPT is a production-ready AI solution for chatting with your documents using Large Language Models (LLMs). The platform is 100% private - no data leaves your execution environment. PrivateGPT offers a complete RAG pipeline (Retrieval Augmented Generation), a FastAPI-based API with OpenAI compatibility, and supports both local and remote LLM providers.
Trusted by leading companies
About PrivateGPT
PrivateGPT is a production-ready AI solution for chatting with your documents using Large Language Models (LLMs). The platform is 100% private - no data leaves your execution environment. PrivateGPT offers a complete RAG pipeline (Retrieval Augmented Generation), a FastAPI-based API with OpenAI compatibility, and supports both local and remote LLM providers.
With PrivateGPT, you can operate a fully local AI solution that intelligently processes documents, searches them, and delivers context-based answers. The solution supports various LLM providers such as Ollama, LlamaCPP, OpenAI, Azure OpenAI, and more - ideal for companies with strict data protection and compliance requirements such as GDPR, healthcare, or legal sectors.
WZ-IT & PrivateGPT
We install, host, and operate PrivateGPT for your company - either completely on-premise in your own environment or on our secure, GDPR-compliant infrastructure in Germany. Enjoy the benefits of private AI with complete data control and no vendor lock-in.
With 24/7 monitoring, enterprise support, automated backups, and professional maintenance, we ensure maximum availability and reliable operation of your PrivateGPT instance. Including support for integrating your preferred LLM providers, document ingestion, and RAG optimization.
100% Privacy & Data Protection
No data leaves your execution environment. Complete data sovereignty for GDPR-critical companies, government agencies, healthcare, and regulated industries.
Complete RAG Pipeline
Production-ready RAG pipeline with document parsing, splitting, metadata extraction, embedding generation, and contextual chunk retrieval for precise answers.
OpenAI API Compatible
FastAPI-based architecture with OpenAI-compatible API. Seamless integration into existing tools and workflows without changes to your code.
Fully Local Operation
Can be operated completely offline and locally - on-premise, in your private cloud, or air-gapped environment. No dependency on external cloud services.
Flexible LLM Provider Support
Supports local providers (Ollama, LlamaCPP) and remote providers (OpenAI, Azure OpenAI, Sagemaker, etc.). Flexibly switch between different models.
Intelligent Document Ingestion
Automatic document processing with parsing, chunking, metadata extraction, and embedding generation for optimal RAG performance and search results.
Full Data Sovereignty
All data remains under your control. Perfect for GDPR compliance, confidential business data, patient records, legal documents, and sensitive information.
100% Open Source
PrivateGPT is completely open source (Apache-2.0 license) and enables full transparency, security audits, and customizations according to your specific requirements.
No Vendor Lock-in
Based on LlamaIndex framework. Free choice between different LLM providers, vector databases, and deployment models without dependency on individual vendors.
PrivateGPT Installation & Einrichtung
Professional installation on your infrastructure – on-premise, cloud or hybrid
On-Premise
In your data center
- Installation on bare-metal, VM or Docker
- Optimal performance configuration
- Integration with existing Active Directory/LDAP
- SSL certificate & reverse proxy
- Backup strategy & monitoring
- Security hardening following best practices
- Documentation & training
Cloud Installation
AWS, Azure, Hetzner & more
- Installation on AWS, Azure, GCP, Hetzner
- Terraform/IaC setup (optional)
- Kubernetes or Docker Compose
- Auto-scaling configuration
- Load balancer & CDN integration
- CloudWatch/monitoring setup
- Cost optimization & best practices
Enterprise Setup
High-availability setup with comprehensive security and compliance features
- High-availability cluster setup
- VPN access (e.g. WireGuard, NetBird, Tailscale)
- SSO integration (e.g. Keycloak, Authentik, Azure AD)
- Multi-factor authentication (MFA)
- Audit logging & compliance
- Disaster recovery plan
- Custom security policies
- Dedicated contact person
Perfekt für diese Anwendungsfälle
privategpt_usecase_1_title
privategpt_usecase_1_desc
privategpt_usecase_2_title
privategpt_usecase_2_desc
privategpt_usecase_3_title
privategpt_usecase_3_desc
privategpt_usecase_4_title
privategpt_usecase_4_desc
privategpt_usecase_5_title
privategpt_usecase_5_desc
privategpt_usecase_6_title
privategpt_usecase_6_desc
Security & Secure Access
Secure access and access control for your installation
VPN Access
WireGuard, NetBird or Tailscale
SSO Integration
Keycloak, Authentik, Azure AD
Multi-Factor Auth
TOTP, WebAuthn, YubiKey
Firewall & Hardening
Fail2Ban, Rate Limiting, IP Whitelisting
Secure Access via VPN
We set up secure VPN access to your installation – ideal for remote work and external employees.
- Zero-Trust Network Access (ZTNA)
- Encrypted connections
- Easy client setup for all devices
- Centralized access management
Supported VPN Solutions:
What's Included in the Service
Full-service installation with no hidden costs
PrivateGPT Development & Integration
PrivateGPT enables local LLM usage with your own documents. We integrate it into your existing infrastructure and extend capabilities.
REST API
Via the API we connect PrivateGPT to your systems: Chat completion, document ingest, and context retrieval can be controlled programmatically.
Document Processing
We develop custom ingestion pipelines: Special document types (CAD, contracts, code) are processed with optimized chunking strategies.
LlamaIndex Extensions
The LlamaIndex backend allows deep customization: Custom retrievers, rerankers, and embedding models for domain-specific search.
Concrete Use Cases
How we implement PrivateGPT development in practice.
Air-Gapped Deployment
Highly sensitive environments (government, defense) cannot have cloud connections but need LLM capabilities.
Fully offline-capable setup with local models, own embeddings, and airgapped update mechanisms.
Legal Document Discovery
Lawyers need to search thousands of documents for relevant passages. Manual review takes weeks.
PrivateGPT with legally optimized chunking and retrieval. Questions in natural language, answers with source references.
Email Assistant
Executives receive hundreds of emails daily. Summaries and prioritization are needed.
PrivateGPT integration that analyzes, summarizes, and categorizes emails by urgency – fully on-premise.
Enterprise Managed Hosting
Enterprise Grade
Open source enterprise-ready for productive workloads - we run your applications with highest security standards and enterprise support
Why Enterprise Managed Hosting?
Open source software for business-critical processes requires professional maintenance, continuous updates, and enterprise-grade support. With our PrivateGPT Enterprise Managed Hosting, you get the necessary infrastructure and support to reliably operate open source in production environments. Backups, SLAs, telephone support, and personal contact - so you can focus on your core business.
Installation on Your Infrastructure
Looking for a custom solution?
We also offer customized PrivateGPT Enterprise solutions for your specific requirements. Contact us for an individual quote.
The Perfect Hardware for Your AI Applications
From fully managed GPU servers to compact AI Cubes – we provide the ideal infrastructure for your local LLM applications.
Managed GPU Servers
Powerful GPU servers with dedicated hardware for compute-intensive LLM workloads. Fully managed, scalable, and optimized for maximum performance.
- NVIDIA RTX GPUs
- 24/7 Monitoring & Support
- Flexible scaling on demand
- European hosting (GDPR compliant)
AI Cube
Compact AI workstation for local LLM inference. Perfect for office environments, with top-tier performance and absolute data sovereignty.
- NVIDIA RTX GPUs
- 100% local data processing
- Plug & Play setup
- Ideal for law firms & offices
Interested in PrivateGPT?
Good choice – we'll help you get started or with operations.
Manage Your Stack in the Customer Portal
As a Managed Service customer at WZ-IT, you have access to our exclusive portal: Monitor your infrastructure in real-time, schedule maintenance, request quotes, and get direct support – all in one central location.
- Real-time infrastructure status
- Reschedule maintenance windows yourself
- View complete access logs
- Direct support without detours
Industry-leading companies rely on us
What do our customers say?
Let's Talk About Your Idea
Whether a specific IT challenge or just an idea – we look forward to the exchange. In a brief conversation, we'll evaluate together if and how your project fits with WZ-IT.
Trusted by leading companies
Timo Wevelsiep & Robin Zins
CEOs of WZ-IT