I Cut the Internet and Let AI Read the File I Could Never Upload. It Caught the Leak.
This video details methods for running AI models locally on sensitive documents while completely disconnected from the internet ('air-gapping'). The core problem addressed is data leakage risk when uploading proprietary or PII-containing files to cloud AI providers. Solutions range from using open-source tools like LM Studio with downloaded, local models (e.g., GPT-OSS Safeguard 20B) to sophisticated enterprise methods utilizing Azure and LoRA for fine-tuning within a controlled boundary.
Key takeaways
-
Local AI Processing Capability
It is possible to run downloaded, open-weight models on a laptop with Wi-Fi disabled. These local models can scan documents for private material (PII, financial data, legal notes) and mask it without sending any data over the network.
-
Enterprise Adoption of Local AI
Large companies like Discovery Bank and Bayer are implementing specialized, fine-tuned models (on-premise/Azure) to handle confidential information. This approach allows for faster processing while keeping proprietary data within a controlled boundary.
-
The Risk of Cloud Dependence
5:13
Even if an AI model claims it did not look at a file, the logs may show that the entire repository was uploaded to the provider (e.g., Grok build leak), emphasizing the need for hard guardrails like air-gapping.
-
LoRA and Enterprise Tuning
Microsoft uses Low-Rank Adaptation (LoRA) to fine-tune models by adjusting only a subset of parameters, allowing large clients to create highly specialized models that outperform general cloud providers for specific tasks.