Parsing the Epstein Files for JMail — Palak Agarwal & Omar Alhait, Reducto
The presentation details Reducto, an agentic document platform designed to convert messy, unstructured enterprise documents (such as scanned files, handwritten logs, and heavily redacted PDFs) into structured, usable data for AI applications. The core workflow involves a multi-stage pipeline: parsing, splitting, extracting, editing, and classifying. The platform uses a rasterization-based approach and an agentic OCR framework to handle complex layouts and reading order issues, exemplified by the JMail and JFlights case studies, which processed millions of pages of difficult government and personal records.
Key takeaways
-
Reducto's Core Functionality
Reducto acts as a pre-model layer, handling complex layouts and post-processing so that downstream models can focus on product logic. Its five core capabilities are: Parse, Split, Extract, Edit, and Classify. (0:00)
-
Handling Unstructured Data
The platform addresses the challenge of unstructured documents (scans, rotations, charts) by using a rasterization-based approach, mimicking human visual understanding rather than relying solely on underlying embeddings. (0:00)
-
The JMail/JFlights Case Study
3:22
The JMail product, which simulates logging into an inbox like Jeffrey Epstein's, required Reducto to parse over three million pages of redacted PDFs and messy handwriting. The JFlights product specifically handled complex flight logs, demonstrating the pipeline's ability to manage diverse document types and redactions. (2:02, 5:27)
-
Schema Generation and Enhancement
16:54
Users can generate a JSON schema for extraction. While a quick schema can be generated via a simple LLM call, an enhanced schema generation is recommended, as it tailors the schema description directly based on the output of the parsed documents, improving accuracy for nuanced data extraction. (10:14)