What if your local machine could run high-throughput LLMs, multimodal models, or even fine-tune small AI models with GPU acceleration? In this new episode of AI Guide to the Galaxy, Oleg sits down with Eric from the Docker Model Runner team to explore how the project is evolving to make all of that possible. 🎙️ In this episode: - How Docker Model Runner is expanding support for engines like VLLM and NVIDIA NIMs - Running models on AMD GPUs and integrated graphics via Vulkan - Using multimodal m
1:15
What if your local machine could run high-throughput LLMs, multim…
784 views3 months ago
FacebookDocker
[vLLM Office Hours #41] LLM Compressor Update & Case Study - January 22, 2026
1:00:34
[vLLM Office Hours #41] LLM Compressor Update & Case Stud…
710 views1 month ago
YouTubeRed Hat
DigitalOcean on Instagram: "Don't let lazy GPUs stop you from hosting LLMs locally. 🤖 In this video, you’ll learn what vLLM is, how it fixes inefficient GPUs, & how to host it on DigitalOcean GPU Droplet in just minutes. Link in bio. 🔗"
0:29
DigitalOcean on Instagram: "Don't let lazy GPUs stop you from hosti…
825 views3 months ago
Instagramthedigitalocean
Installing LLVM
5:47
Installing LLVM
27.4K viewsDec 20, 2020
YouTubeCompilersLab
vLLM: Easily Deploying & Serving LLMs
15:19
vLLM: Easily Deploying & Serving LLMs
28.6K views6 months ago
YouTubeNeuralNine
VLC Media player inside Docker
6:58
VLC Media player inside Docker
5.7K viewsJun 1, 2021
YouTubeMetaHiberTech - Sudhanshu Pandey
vLLM - Turbo Charge your LLM Inference
8:55
vLLM - Turbo Charge your LLM Inference
20.2K viewsJul 7, 2023
YouTubeSam Witteveen
26:06
Ollama AI Home Server ULTIMATE Setup Guide
55.3K viewsAug 4, 2024
YouTubeDigital Spaceport
27:31
vLLM on Kubernetes in Production
7.8K viewsMay 17, 2024
YouTubeKubesimplify
17:18
Install Qwen3-14B with vLLM Locally
3.1K views10 months ago
YouTubeFahd Mirza
35:23
The State of vLLM | Ray Summit 2024
4.9K viewsOct 18, 2024
YouTubeAnyscale
8:17
vLlama: Ollama + vLLM: Hybrid Local Inference Server
5.6K views3 months ago
YouTubeFahd Mirza
6:13
Optimize LLM inference with vLLM
10.9K views7 months ago
YouTubeRed Hat
5:57
Optimize for performance with vLLM
2.5K views10 months ago
YouTubeRed Hat
7:03
vLLM: Introduction and easy deploying
1.9K views3 months ago
YouTubeDigitalOcean
1:34:01
金枪鱼之夜：vLLM: 简单、高效、低成本的大模型推理框架
290 views4 months ago
YouTubeTUNA
52:35
vLLM Office Hours - Advanced Techniques for Maximizing vLLM …
4.3K viewsSep 23, 2024
YouTubeNeural Magic
15:09
Better Than RunPod? RunC.AI LLM Deploy and Inference
1.2K views9 months ago
YouTubeAI Anytime
9:30
Setup vLLM with T4 GPU in Google Cloud
6.6K viewsAug 10, 2023
YouTubeCodeJet
5:58
vLLM: AI Server with 3.5x Higher Throughput
17.6K viewsAug 10, 2024
YouTubeMervin Praison
1:13:42
How the VLLM inference engine works?
12.9K views5 months ago
YouTubeVizuara
26:15
Bay.Area.AI: torch.compile and vLLM, Antoni Viros Martin
685 viewsApr 29, 2024
YouTubeFunctionalTV
4:33
Deploying vLLM from AMD Infinity Hub with AMD ROCm™ Software …
1.7K viewsJan 28, 2025
YouTubeAMD Developer Central
8:34
LiteLLM Tutorial to Call Any LLM with API Locally
11.6K viewsOct 21, 2023
YouTubeFahd Mirza
4:43
Docker vs Virtual Machine | simply explained || Docker Tutorial 6
135.4K viewsNov 4, 2019
YouTubeTechWorld with Nana
1:01:11
vLLM: Virtual LLM #vllm #learnai
1.7K viewsDec 11, 2024
YouTubeAI Makerspace
59:07
vLLM Office Hours #22 - Intro to vLLM V1 - March 27, 2025
3.2K views11 months ago
YouTubeNeural Magic
1:00:11
[vLLM Office Hours #25] Structured Outputs in vLLM - May 8, 2025
1.4K views10 months ago
YouTubeNeural Magic
12:27
Deploy vLLM on AWS in under 10 Minutes!
939 views5 months ago
YouTubeThe Ansible Playbook
8:21
How to Run vLLM on CPU - Full Setup Guide
6.9K views10 months ago
YouTubeFahd Mirza
See more videos
Static thumbnail place holder