On Docker Desktop, open Settings, go to AI, and enable Docker Model Runner. If you are on Windows with a supported NVIDIA GPU ...
if you've ever built any kind of llm or gen type application chances are you've got it working locally and eventually you're going to want to share this with other people or even push this into ...