SelfHosting

Soon you are juggling vLLM, llama.cpp, and more—each stack on its own port. Everything downstream still wants one /v1 base URL; otherwise you keep shuffling ports, profiles, and one-off scripts. llama-swap is the /v1 proxy before those stacks.

Most local AI setups start with a model and a runtime.

I keep coming back to llama.cpp for local inference—it gives you control that Ollama and others abstract away, and it just works. Easy to run GGUF models interactively with llama-cli or expose an OpenAI-compatible HTTP API with llama-server.

Most local AI setups start the same way: a model, a runtime, and a chat interface.

Choosing the right headless CMS can make or break your content management strategy. Let’s compare three open-source solutions that influence how devs build content - driven applications.

Nextcloud is the leading open-source, self-hosted cloud storage and collaboration platform that puts you in complete control of your data.

Immich is a revolutionary open-source, self-hosted photo and video management solution that gives you complete control over your memories. With features rivaling Google Photos - including AI-powered facial recognition, smart search, and automatic mobile backup - all while keeping your data private and secure on your own server.

Elasticsearch is a powerful distributed search and analytics engine built on Apache Lucene. This comprehensive cheatsheet covers essential commands, best practices, and quick references for working with Elasticsearch clusters.

Locally hosted Ollama allows to run large language models on your own machine, but using it via command-line isn’t user-friendly. Here are several open-source projects provide ChatGPT-style interfaces that connect to a local Ollama.

Will list here some AI-assisted coding tools and AI Coding Assistants and their nice sides.

Here is a Docker cheat sheet covering the most important commands and concepts from installing to running containers and cleaning up:

When I started experimenting with LLMs the UIs for them were in active development and now some of them are really good.