Self-Hosting

Articles

Articles

SearchTopic
ARTIFICIAL INTELLIGENCE CI/CD CLOUD NATIVE DEVOPS HASHICORP INFRASTRUCTURE AS CODE PLATFORM ENGINEERING SECURITY
Author
Martin Buchleitner Edmund Haselwanter Juergen Brueder Paul Strebenitzer Matthias Theuermann Marina Brooks Infralovers Team Theresa Wallas Miriam Grainer Jan Klare

Ollama

Summary Ollama is a tool for running open-weight large language models locally—on a laptop, workstation, or server—rather than calling a hosted cloud API. It

vLLM

Summary vLLM is an open-source library for serving large language models with high throughput and efficient memory use. Originally developed at UC Berkeley, it

Previous page
Showing of
Next page