Getting an LLM running inside an air-gapped network is the easy part. The hard part comes later: a new model version is released, a security patch lands for your serving engine, a GPU driver needs updating, and none of it can be downloaded from where the system lives.
This