Xinference — 2 Technical Articles

Sep 27, 2025 · Artificial Intelligence

How to Set Up Xinference with NVIDIA RTX 4090 on Oracle Linux: A Step‑by‑Step Guide

This guide walks you through configuring a high‑performance AI inference server on Oracle Linux, covering hardware specs, NVIDIA driver and CUDA installation, Conda environment setup, Xinference deployment, service startup, and example model loading commands, all with clear code snippets and images.

AI inferenceCUDAConda

0 likes · 10 min read

How to Set Up Xinference with NVIDIA RTX 4090 on Oracle Linux: A Step‑by‑Step Guide

Architect's Alchemy Furnace

Mar 31, 2025 · Artificial Intelligence

How to Deploy and Run Large Language Models with Xinference: A Step‑by‑Step Guide

Xinference is a powerful distributed inference framework that enables quick deployment and efficient serving of open‑source large language models via Docker or source installation, offering Web UI, CLI, and API interfaces with detailed setup, model launching, and Chatbox integration instructions.

APIDockerInference

0 likes · 11 min read

How to Deploy and Run Large Language Models with Xinference: A Step‑by‑Step Guide