{"id":8771,"date":"2025-07-20T07:30:53","date_gmt":"2025-07-20T04:30:53","guid":{"rendered":"https:\/\/handoli.com\/index.php\/2025\/07\/20\/data-machina-257\/"},"modified":"2025-07-20T07:30:53","modified_gmt":"2025-07-20T04:30:53","slug":"data-machina-257","status":"publish","type":"post","link":"https:\/\/handoli.com\/index.php\/2025\/07\/20\/data-machina-257\/","title":{"rendered":"Data Machina #257"},"content":{"rendered":"

On Compound AI Systems, Txt2SQL & Data Agents. <\/strong>A year ago or so, a client enthusiastically presented us with a long list of \u201cAI LLM projects<\/em>.\u201d Among them, there was one project listed as: \u201cuse text-to-sql to automate all data analysis tasks<\/em>\u201d \u2026 We thought: \u201cUmm\u2026 this is going to be an interesting<\/em> project\u201d\u2026 Months later the client abandoned the project. <\/p>\n

Pioneers in Text-to-SQL at enterprise scale<\/strong>. afaik, Pinterest was one of the first companies that deployed Tex2SQL at scale in enterprise production. Importantly, they were one of the first ones in sharing their experience. This is an excellent post in which the engineering team describes the whole journey from academic Txt2SQL to production. Blogpost: How we built Text-to-SQL at Pinterest<\/a>.<\/p>\n

\n
\n
\"\"\/\n
\n
\n
<\/div>\n
<\/div>\n<\/div>\n<\/div>\n<\/div>\n

<\/p><\/a><\/figure>\n<\/div>\n

Text-to-SQL augmented with RAG: Not easy yet<\/strong>. Sure! LLMs can write beautiful, syntactically correct SQL statements because there are tons of public SQL code on which LLMs have been trained on. But LLMs have quite a bit of challenges when dealing with real-world relational data problems. Top 4 Challenges using RAG with LLMs to Text-to-SQL and how to solve it<\/a>.<\/p>\n

Text-to-SQL or human-like AI analysts?<\/strong> This is an interesting post by the team at Pattern, a startup building a financial analysis agent. Their main idea: Text-to-SQL should be more like Text-to-Analysis that works at the business layer. And the LLM -beyond prompting- should behave like a human analyst by using multiple, specialist AI agents that contribute to the analysis process. Blogpost: Text to SQL and its uncanny valley.<\/a> <\/p>\n

Agents for data workflows<\/strong>. In the real world, data workflows with several data pipelines with messy, dirty, changing data are an absolute nightmare! Enter Meadow: An open source, agentic framework for building multi-agent data workflows with LLMs with interactive user feedback. Meadow\u2019s approach is to chain several specialised agents like Text-to-SQL, Planner, Executor, Schema Cleaner, Validator, Router agents to perform an end to end data workflow. Blogpost and repo here: Introducing Meadow: LLM Agents for Data Tasks<\/a>. <\/p>\n

\n
\n
\"\"\/\n
\n
\n
<\/div>\n
<\/div>\n<\/div>\n<\/div>\n<\/div>\n

<\/p><\/a><\/figure>\n<\/div>\n

Compound AI Systems and LLM Data Agents<\/strong>. In February, researchers at Berkeley AIR published an article on the rapid Shift from Models to Compound AI Systems.<\/a> In contrast to a \u201cclassic\u201d rather static AI model, a Compound AI System interacts with multiple components\u2026 function calls, APIs, search, retrievers, agents\u2026 The researchers argue that you should design and implement an AI system from the perspective of a Compound AI System. <\/p>\n

More recently, Howard at Wren.ai – a startup offering RAG-Txt2SQL solutions- wrote a great post on the new wave and the concept of Composable Data Systems and the Interface to LLM agents<\/a>. And Mosaic AI (aka Databricks AI) just announced a series of new capabilities on building and deploying production-quality Compound AI Systems<\/a>.<\/p>\n

\n
\n
\"\"\/\n
\n
\n
<\/div>\n
<\/div>\n<\/div>\n<\/div>\n<\/div>\n

<\/p><\/a><\/figure>\n<\/div>\n

A fully open source NL engine for SQL DBs<\/strong>. Last month, the team at Dataherald open sourced natural language-to-SQL engine built for enterprise-level question answering over relational data. It allows you to set up an API from your database that can answer questions in plain English. You can do NL Q&A on Prod DBs, NL queries the DW directly without IT support, or create a ChatGPT plugin. Repo and docs here: Interact with your SQL database, Natural Language to SQL using LLMs<\/a>.<\/p>\n

Open Source AI Agents for Data Analysis<\/strong>. PandasAI just open sourced a Python library that makes it easy to ask questions to your data in natural language. Beyond querying, PandasAI offers functionalities to visualize data through graphs, cleanse datasets by addressing missing values, and enhance data quality through feature generation, making it a comprehensive tool for data scientists and analysts. Checkout the repo and docs here: Pandas AI – AI agents for Data Analysis<\/a>.<\/p>\n

Free course: Building Your Own Database Agent<\/strong>. In this course, you will develop an AI agent that interacts with databases using natural language, simplifying the process for querying and extracting insights. To know more and join this free course click here<\/a>.<\/p>\n\n

Have a nice week.<\/p>\n

Subscribe now<\/span><\/a><\/p>\n

10 Link-o-Troned<\/strong><\/h3>\n
    \n
  1. \n

    My Thoughts on Apple Intelligence Models<\/a><\/p>\n<\/li>\n

  2. \n

    AI Search: The Bitter-er Lesson<\/a><\/p>\n<\/li>\n

  3. \n

    Building AI Agents: Lessons Learned over the Past Year<\/a><\/p>\n<\/li>\n

  4. \n

    [gotcha] LLM Dataset Inference: Did you Train on My Dataset? <\/a><\/p>\n<\/li>\n

  5. \n

    A Systematic Survey on [the latest] Prompting Techniques, 6\/2024<\/a><\/p>\n<\/li>\n

  6. \n

    The Challenges of Retrieving & Evaluating Relevant Context for RAG<\/a><\/p>\n<\/li>\n

  7. \n

    NVIDIA Nemotron-4 340B: A SOTA Open Synthetic DataGen Pipeline<\/a><\/p>\n<\/li>\n

  8. \n

    [new] Memory Tuning: 95% LLM Accuracy, 10x Fewer Hallucinations<\/a><\/p>\n<\/li>\n

  9. \n

    [free, very comprehensive] Generative AI for Beginners v2, 18 Lessons<\/a><\/p>\n<\/li>\n

  10. \n

    [great] Stanford CS25 v4: A Highly Opinionated View on Transformers<\/a><\/p>\n<\/li>\n<\/ol>\n

    \n
    \n<\/div>\n

    Share Data Machina with your friends<\/span><\/a><\/p>\n

    \n
    \n<\/div>\n

    the ML Pythonista<\/strong><\/h3>\n
      \n
    1. \n

      [mega session] Karpathy\u2019s <\/a>Let\u2019s Reproduce GPT-2<\/a><\/em><\/p>\n<\/li>\n

    2. \n

      Function Calling with OpenAI APIs: A Crash Course<\/a><\/p>\n<\/li>\n

    3. \n

      agentUniverse – An Apache 2.0 Framework for Multi-Agent Apps<\/a><\/p>\n<\/li>\n<\/ol>\n

      Deep & Other Learning Bits<\/strong><\/h3>\n
        \n
      1. \n

        [free] Step-by-Step Diffusion: An Elementary Tutorial (pdf)<\/a><\/p>\n<\/li>\n

      2. \n

        [official] Intro to Apple\u2019s On-Device & Server Foundation Models<\/a><\/p>\n<\/li>\n

      3. \n

        Can LLMs Invent Better Ways to Train LLMs? An Auto-Evolutionary Approach<\/a><\/p>\n<\/li>\n<\/ol>\n

        AI\/ DL ResearchDocs<\/strong><\/h3>\n
          \n
        1. \n

          DeepMind – Transformers Meet Neural Algorithmic Reasoners<\/a><\/p>\n<\/li>\n

        2. \n

          Together.ai – Mixture of Agents (MoAs) Enhances LLMs Capabilities<\/a><\/p>\n<\/li>\n

        3. \n

          MSR – Samba: Mamba SSM + MLP + Sliding Window for Unlimited Context<\/a><\/p>\n<\/li>\n<\/ol>\n

          MLOps Untangled<\/strong><\/h3>\n
            \n
          1. \n

            LangFuse – An Open Source LLM Engineering Platform<\/a> <\/p>\n<\/li>\n

          2. \n

            Choosing Slurm vs Kubernetes for Modern ML Workloads<\/a><\/p>\n<\/li>\n

          3. \n

            LLM Monitoring and Observability: Tools, Tips & Best Practices<\/a><\/p>\n<\/li>\n<\/ol>\n

            ML Datasets & Stuff<\/strong><\/h3>\n
              \n
            1. \n

              What If We Recaption Billions of Web Images with LLaMA-3?<\/a><\/p>\n<\/li>\n

            2. \n

              NVIDIA HelpSteer2: An Open Dataset for Training Top Reward Models<\/a><\/p>\n<\/li>\n

            3. \n

              Character Codex: A Dataset of Characters in Comics, Movies, TV Shows for GenAI<\/a><\/p>\n<\/li>\n<\/ol>\n

              Postscript, etc <\/strong><\/h3>\n
              \n
              \n

              Enjoyed this post? Tell your friends about Data Machina. Thanks for reading.<\/p>\n<\/div>\n

              Share<\/span><\/a><\/p>\n<\/div>\n

              Tips? Suggestions? Feedback?\u00a0email Carlos<\/a><\/p>\n

              Curated by\u00a0@ds_ldn\u00a0<\/a>in the middle of the night.<\/p>","protected":false},"excerpt":{"rendered":"

              On Compound AI Systems, Txt2SQL & Data Agents. A year ago or so, a client enthusiastically presented us with a long list of \u201cAI LLM projects.\u201d Among them, there was one project listed as: \u201cuse text-to-sql to automate all data analysis tasks\u201d \u2026 We thought: \u201cUmm\u2026 this is going to be an interesting project\u201d\u2026 Months […]<\/p>\n","protected":false},"author":1,"featured_media":8772,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"rop_custom_images_group":[],"rop_custom_messages_group":[],"rop_publish_now":"initial","rop_publish_now_accounts":[],"rop_publish_now_history":[],"rop_publish_now_status":"pending","footnotes":""},"categories":[54],"tags":[],"class_list":["post-8771","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-airepos"],"_links":{"self":[{"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/posts\/8771","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/comments?post=8771"}],"version-history":[{"count":0,"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/posts\/8771\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/media\/8772"}],"wp:attachment":[{"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/media?parent=8771"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/categories?post=8771"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/tags?post=8771"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}