Why Datasite Stopped Building Its Own Parsing - Adit Abraham, Reducto & Raj Bakhru, Datasite
Summary
Datasite's CTO, Raj Bakhru, details how his company integrated advanced AI into its platform, which handles 60% of all transactions over $100 million. The core challenge was parsing massive amounts of highly sensitive, unstructured data (VDRs). Bakhru emphasizes that the complexity of 'edge cases' (e.g., merged cells, chart interpretation in Excel) made building the parsing layer internally impractical. They strategically leveraged Reducto's tooling to solve the extraction problem, allowing their 250 engineers to focus on high-value, revenue-generating initiatives like building Graph RAG and advanced agents, rather than 'rebuilding the wheel' on data ingestion.
Key takeaways
-
The Scale of Unstructured Data
3:30
Datasite processes billions of pages of content across 55,000 data rooms annually, making the management of Material Non-Public Information (MNPI) and unstructured data a massive AI priority.
-
The 'Edge Case' Problem in Parsing
7:20
Parsing financial documents is defined by 'all edge cases.' Issues like interpreting chart data (e.g., shade of blue on a legend) or handling complex Excel formats (like XLSB or merged cells) require specialized tooling, making internal development costly and time-consuming.
-
Strategic Build vs. Buy Decisions
11:30
To maximize the impact of their 250 engineers, Datasite shifted focus from building foundational data extraction layers to building value-add, revenue-generating AI products (e.g., agents, Graph RAG).
More digests on AI Engineering
Technical details
-
Data Ingestion and Architecture
1090s
The system uses a specialized ingestion pipeline that passes content through Reducto's tooling, which then feeds the data into a vector database (Turbo Buffer). The final layer is a Graph RAG platform, with queries executed using proprietary Python code.
-
Performance Benchmarking (VDR Bench)
1140s
Datasite uses a custom evaluation, 'VDR Bench,' which tests the system against a common virtual data room of hundreds of documents. They reported a 22% improvement in recall rate directly attributed to the superior content extraction capabilities of Reducto's parsing.
-
AI Development Strategy
730s
The focus for internal engineering talent is on solving the hardest business problems (e.g., building agents for complex diligence analysis) rather than optimizing foundational data layers. Optimization efforts are constantly balancing three factors: cost, speed, and quality.
Mentioned resources
Channel & topics
Watch on YouTube · Back to latest
This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.