Header image

Session 3.3f: Tutorial - RamaLama, Ollama, LllamaStack, LlamaFirewall, vLLM. Oh my!

Tracks
Thursday, November 20, 2025
10:30 AM - 11:30 AM
Swan Room

Details

Open source is driving rapid innovation in AI/ML, with a wave of new projects and tools emerging at pace. But with so many names and technologies, it can be hard to cut through the noise. What do these tools actually do, and how are they delivering real capabilities to the modern battlefield? In this tutorial, Red Hat’s Ben Shepherd and Shane Boulden will unpack the evolving landscape of open source AI and machine learning. You'll gain clarity on the most relevant technologies, what they mean in practice, and how they're being used to support today’s warfighter across air, land, sea, space, and cyber domains. Whether you're just starting your journey or looking to deepen your understanding, this session will show you how to harness open source inference in your own environment—securely, flexibly, and at scale.


Speaker

Agenda Item Image
Mr Ben Shepherd
Account Solution Architect
Red Hat

Biography

Ben Shepherd has been around technology for a while; from flying the AP-3C Orion through to deploying containers. His background is in cyber security, and brings this passion to enabling tcapability while ensuring compliance.
loading