Turning My Obsidian Vault Into a Local AI Engineer — Filip Makraduli, Superlinked
This talk details building a private, cost-efficient, and highly adaptable AI workflow using an Obsidian vault as a knowledge base. The solution, built around Superlinked's open-source model inference engine and an MCP (Model Communication Protocol) integration, allows users to offload sensitive document processing (like OCR and redaction) to a self-controlled Virtual Private Cloud (VPC). This approach addresses critical concerns regarding data privacy, high token costs associated with large models, and the need for task-specific model adaptation (LoRAs) in sensitive enterprise environments.
Key takeaways
-
Privacy and Cost Control
The system offloads sensitive document processing (e.g., OCR, redaction) to a self-hosted VPC, ensuring that raw, sensitive data never leaves the controlled environment, thus mitigating privacy risks and reducing token costs compared to sending all data to external APIs.
-
Modular and Adaptable Inference
17:20
Superlinked provides an open-source inference engine that supports multiple models (including task-specific LoRAs) running on dedicated GPU worker pools. This allows for model hot-swapping and testing different models for optimal performance and cost.
-
Infrastructure Control (MCP)
15:11
The MCP setup establishes a clear separation of responsibilities: the client/host interacts with the MCP server, which coordinates with the dedicated GPU worker pools. This architecture provides granular control over resource allocation (e.g., picking specific worker pools or GPU types) and ensures the entire process runs within the user's private cloud.