The modern data stack after LLMs: where ETL, warehousing, and BI are heading

Here is a venture analyst’s end-to-end market map of the Modern Data Stack (MDS) in the era of LLMs.

1. Thesis

LLMs are restructuring the modern data stack from a deterministic, pipeline-to-dashboard assembly line into an agentic, conversational ecosystem where unstructured data is a first-class citizen and insights are generated on demand rather than pre-computed.

2. Market Segments & Dynamics

Segment 1: AI-Native ETL & Unstructured Data Ingestion

• Companies: Unstructured, Airbyte, Fivetran, dbt Labs, Snorkel AI.
• Dynamics: Traditional ETL players are racing to add vectorization and unstructured data parsing, while AI-native upstarts (like Unstructured) are building pipelines specifically designed to feed complex documents into LLMs and vector databases.

Segment 2: Vector-Augmented Warehouses & Lakehouses (Storage & Compute)

• Companies: Databricks, Snowflake, Pinecone, Weaviate, ClickHouse.
• Dynamics: The battle here is between dedicated vector databases (Pinecone, Weaviate) and incumbent data warehouses (Databricks, Snowflake) that are aggressively absorbing vector search capabilities to prevent data from leaving their ecosystems.

Segment 3: The Generative BI & Semantic Layer

• Companies: ThoughtSpot, Defog.ai, Vanna.ai, Cube, dbt Labs. (Note: Defog and Vanna are earlier-stage startups, but represent the pure-play Text-to-SQL movement).
• Dynamics: Traditional static dashboards are being replaced by conversational interfaces and "chat-to-data" tools, forcing a massive reliance on robust Semantic Layers (Cube, dbt) to prevent LLMs from hallucinating SQL queries.

Segment 4: Data Quality & LLMOps for the Enterprise

• Companies: Arize, Braintrust, Patronus AI, Monte Carlo, Anomalo.
• Dynamics: Traditional data observability (Monte Carlo) is colliding with LLM evaluation (Braintrust, Patronus); enterprises cannot deploy generative BI without automated guardrails to verify that the LLM's data outputs are accurate and compliant.

3. Which Segment Wins the Most Value and Why?

Vector-Augmented Warehouses & Lakehouses (Databricks, Snowflake) will capture the most value. Why: Data gravity. Moving petabytes of data is expensive and introduces security/compliance risks. Rather than piping data out to external LLM tools or standalone vector databases, enterprises prefer to bring the compute (LLMs) to the data. By offering native vector storage, fine-tuning, and hosted LLMs (e.g., Databricks acquiring MosaicML, Snowflake's Cortex), the foundational storage layers will successfully bundle and commoditize many of the standalone AI tools built around them.

4. White-Space Opportunities

• Opportunity 1: Automated Semantic Layer Generation. Currently, text-to-SQL fails because LLMs don't understand the messy, undocumented business logic of a company's raw tables. There is a white space for an AI agent that crawls a company's dbt repos, historical SQL queries, and Slack channels to automatically build and maintain a perfect, machine-readable semantic layer (ontology) without requiring months of manual data engineering.
• Opportunity 2: Agentic Reverse-ETL. Traditional Reverse-ETL (e.g., Hightouch, Census) simply syncs warehouse data back into SaaS apps (like Salesforce). The white space is an "Agentic" Reverse-ETL platform where LLMs don't just sync data, but autonomously execute workflows based on warehouse changes (e.g., "The warehouse shows a user's usage dropped 20%; automatically draft a personalized email, adjust their Salesforce lead score, and create a Zendesk ticket for the CSM").