Month: February 2024

Docker image: https://hub.docker.com/r/siutin/stable-diffusion-webui-docker docker pull siutin/stable-diffusion-webui-docker:latest-cpu   https://github.com/siutin/stable-diffusion-webui-docker Run it: docker run -it –name sdw –network host -v $(pwd)/models:/app/stable-diffusion-webui/models -v $(pwd)/outputs:/app/stable-diffusion-webui/outputs –rm siutin/stable-diffusion-webui-docker:latest-cpu bash webui.sh –skip-torch-cuda-test –no-half –use-cpu all –share…

(1) use container https://github.com/abetlen/llama-cpp-python/pkgs/container/llama-cpp-python (2) mount k8s storage as /models export MODEL point to the right llama-model.gguf (3) expose 8000 to loadbalancer to outside (4) browse to ip:8000/docs for API…

Ollama is a front-end written in go, and wrap-up the back-end of llama.cpp Here is the steps for setup ollama in k8s cluster (1) write a k8s yaml file, where…

HW Purpose: Add old laptop  to existing k8s HW: Add Laptop with only Wifi ( no ethernet port) Software debian 12 (1) k8s apt-get install bridge-utils apt-get install nfs-common sudo…