# Building an Auto Total-Loss Claims Workflow with LlamaParse

## Executive summary

This presentation details the construction of an end-to-end automated total-loss auto claims workflow using LlamaIndex Parse. The solution addresses the challenge of processing complex, unstructured documents (like scanned PDFs and option grids) by implementing a multi-stage pipeline: Classification and Splitting $\rightarrow$ Parsing (to structured formats like JSON/Markdown) $\rightarrow$ Extraction (key-value pair retrieval). The workflow integrates these AI components with a deterministic rules engine and human-in-the-loop review queues, significantly improving data accuracy, reducing operational costs, and providing full traceability via confidence scores and bounding boxes.

## Key takeaways

- Multi-Stage Document Processing Pipeline: The workflow moves from receiving a 'packet' of concatenated documents to individual, usable data. Key steps include: 1) **Classifying and Splitting** the packet into discrete documents (e.g., valuation report, title). 2) **Parsing** the documents into machine-readable formats (JSON/Markdown). 3) **Extracting** specific key-value pairs using defined schemas, while retaining bounding boxes and confidence scores.
- Enhanced Accuracy and Traceability: The system provides high confidence in extracted data by offering bounding boxes and confidence scores for every field. This allows downstream validation steps to pinpoint discrepancies (e.g., mileage mismatch between documents) and guide human reviewers to the exact source of the error.
- Workflow Automation and Cost Optimization: The process is automated through a deterministic rules engine and review queues. The use of a 'cost optimizer' toggle allows for cost-effective processing by routing simpler pages to lower-compute tiers, while complex, degraded scans utilize higher tiers (like Agentic Plus) to maintain accuracy.

## Technical details

- LlamaIndex Parse Capabilities: Parse transforms unstructured document formats (scanned PDFs, large Excel tables, 130+ formats) into structured data (Markdown or JSON). It offers version tiers to balance accuracy and cost, with advanced models like Agentic Plus handling complex, degraded, or multi-page charts/tables.
- Extraction and Schema Definition: Extraction pulls specific key-value pairs based on a defined JSON schema. The output includes bounding boxes and confidence scores, allowing users to set thresholds to determine if data requires a human review (e.g., if confidence is below 0.6).
- Workflow Components: The end-to-end workflow includes: 1) **Classification/Splitting** (separating documents). 2) **Parsing** (structuring data). 3) **Extraction** (pulling fields). 4) **Validation** (deterministic rules engine checking for conflicts, e.g., VIN or mileage mismatches). 5) **Review/Decision** (human-in-the-loop or automated approval/hold).
- Data Integrity Checks: The system incorporates checks for data integrity, including identifying discrepancies (e.g., odometer reading mismatch) and using a 'Verify' product to detect potential document tampering or forgery.

## Practical implications

- Automating the intake and processing of complex, high-volume documents (e.g., auto claims packets) that traditionally require significant manual effort.
- Implementing a robust data validation layer that uses confidence scores and bounding boxes to flag discrepancies automatically, minimizing human error.
- Reducing operational costs by intelligently routing document processing through cost-optimized tiers while maintaining high accuracy for critical data points.

## Topics

Document AI, Natural Language Processing (NLP), Workflow Automation, Data Extraction, Machine Learning Operations (MLOps), LlamaIndex Parse, LlamaIndex Playground, Parse Bench

Source: https://www.youtube.com/watch?v=ytrlq9pIpjo