
In this article I frame and explain the processes I built around Claude and Snowflake to enable production conversational analytics. There are few if any real shortcuts to building an AI analyst agents without an existing data and analytics foundation. An existing Business Intelligence foundation already has semantics, context, lots of connections, and curated understanding. Those foundations can take years to solidify for most companies. The noise to signal in BI systems for AI to consume massive. It carries a lot of bloat, ambiguity, and bad habits that can carry over into your AI agents and produce the same traps for failure.
Starting a new semantics structure in a new platform, technology standard, or tool will yield the same result if you do not establish a strong foundation and process. In this article I provide guidance on my learnings and how I have delivered and continue to manage production AI analysts for credit risk and marketing.
In my primary production environment, I found that 70% of the BI reporting and dashboard requests went away. The remaining 30% is a new class of reporting and dashboard request, where traditional BI tools have become the largest friction point. This is one of many “loops” between analytics builders and information consumers that won’t reveal itself until you have real adoption and accelerate progress forward.
Challenges with Conversational Analytics
Challenge 1: Determining “Important” and “Correct” Context
The hardest part of producing meaningful conversational analytics is determining “important” and “correct” context from existing analytics. Some of that work to separating good / bad context is the basis for the work I started at DataTools Pro in 2023. In this case, bad is anything that introduces ambiguity that can distort descriptive statistics. I use subjective words like “important” and “correct” to highlight why it’s so important to start your AI agents with topics, semantics, and analytics use cases that already drive important decisions today. If you do not have wide adoption of analytics influencing decisions at the start for grounding, you are setting sail on your AI initiative with strong headwinds.
Some ambiguity naturally exists to interpret metrics to arrive at human understanding. How you encode that ambiguity inside of your AI / BI context can poison AI’s ability to stay on track in real world conversational analytics workflows. Evaluating single question with input / output may pass a test. Longer, multi-turn conversations where knowledge and understanding happens requires strong semantic alignment between person and machine.
Challenge 2 – Removing Ambiguity
Decoding ambiguity is a regular business activity every day when people use any business system, including BI. Objectively, the business, data, technology lexicon is a dialect that new people and new agents need to learn. To solve this problem I read a lot of recommendations to “add more context.”
Adding more layers of meta data, skills, context, and AI turns over this data will reach diminishing returns in some form (quality, cost, time). An anecdote I have experienced is business users asking for faster response time where the SQL execution time is <150MS.
My entire AI BI delivery lifecycle calls for continuous reconciliation of context, refining what is important, and removal of ambiguity and layers… This is at the expense of prioritizing correctness and impact over coverage.
As a result, when something does go wrong, rarely is it an AI black box problem.
Removing Ambiguity by removing information. A great example I use is Billing and Shipping state. The semantic meaning is clear for operations for where to bill and where to ship items. For my analytics use case, billing state covers 90% of questions for segmentation. As a result, I remove shipping state from the semantic model and that context is expressed. The alternative approach to add 2 columns and add context for which column to use feels intuitive. The reality is the LLM will at some point get it wrong.
Challenge 3: Prioritize grounding users with BI without repeating BI pitfalls
Delivery and adoption have always been a challenge and a well known black eye for Business Intelligence. The dashboard backlash we see online is a function of technology vendors new solutions to old problems, rarely anticipating some of the new problems highlighted in this article. There are many anecdotes I have experienced in my failed experiments, but the work I do at BIChart has re-taught me that 30-50% of dashboards sitting inside of BI platforms may not be relevant or un-used.
When I started building my first credit risk AI analyst, I selected a widely adopted and trusted BI dashboard for my grounding exercise. My first generations agent needed to understand how to produce and answer any question from BI. On average 30% of what existed in my BI dashboards didn’t need to exist in my AI semantic layer.
Objective – Build High Impact Conversational Analytics
Agent Objective – My approach to conversational analytics was starting with individuals in a small enterprise who directly influence 6 and 7 figure decisions. Otherwise the juice isn’t worth the squeeze. I don’t believe AI analyst agents should be built to save clicks, minutes or even hours… For those use cases there is immense value in traditional automation with AI reasoning steps.
Agent Delivery Objective – The time and cost to build conversational analytics requires lifecycle management that is different than building apps or BI dashboards. This is a CI/CD and governance exercise. The last thing anyone wants to experience is a continuation of business intelligence delivery problems: Initial excitement followed by abandonment.
Framing Real Conversations in Conversational Analytics
Due to the gravity of the decisions, my perspective is the conversation between a user and an AI agent should stay a private, user-controlled space for exploration, ideation, and iteration. Users need room to ask questions, test ideas, bring in their own data, and work through half-formed or sensitive thinking, without assuming the full history is being watched. Even worse, if that chat becomes context for someone else’s session and decision, that kind of feedback loop is dangerous. Specifically for executive users, this is tricky governance problem. An executive chat can carry strategic initiatives, partnership terms, trade secrets, and other need-to-know risk.
That underlying data fed into those conversations also needs to follow a governance policy. Access and audit trail is important for this article because it’s the basis for continuous improvement and how I monitor the system.
Delivery and Training
Participation and training information consumers (end users) how to engage with conversational analytics tool cannot be understated. For me, giving access to Claude + Snowflake required a mandatory 1-hour lab session. My first few generations of LLM was deployed with ChatGPT with over 40 hours of labs. This observation period was great for everyone in the room. I leaned more in 10 hours of labs than 10 months of building and publishing dashboards.
This was the basis for my feedback loop design. I solved for extracting the session notes for continuous improvement. I cover this in my Chat Feedback Skill below.
Closing the Decision Loop: Embedded Conversational Analytics Where Work Happens
My long running secret to BI adoption comes down to one thing: embed analytics where people already work. Logging into a BI portal is a vendor-prescribed experience. A BI portal is something I consider barely tolerable by today’s standards. At organizations that have adopted Claude for Business, I have watched the way of working shift. That will keep evolving, and Claude will likely end up as a stepping stone toward whatever comes next.
Semantics over Semantics
When I speak to different experts, a lot of disconnect exists on semantic layers. Tech vendors are solving systems problems like interoperability, standardization, and distribution without identifying what actually yields the best result. I don’t address any of these things in this article because I believe when enough semantic layers get deployed and folks find it isn’t enough, the next evolutionary step will occur.
The Outer loop: Understanding to Action
To better understand the scope of the actions and decisions I am catering to, I provide my lens on the steps toward “data influenced decisions.” This nebulous marketing headline does have real meaning at its core.
- Information seeking motion requires data and analysis of events, prior actions and outcomes related to established metrics.
- Data and analysis curated and processed to create understanding.
- Understanding requires context take action.
- If consensus or authority is needed for action, an artifact explains the new understanding.
- Communication and authority carries the directive and action occurs.
I have experienced AI tools like Claude accelerate decision makers ability to move through this loop faster. When the semantics and narrowly scoped along with data access, you can get incredible results. The problem shows up after that isolated conversation ends:
- The understanding lives in AI memory / conversation
- The data / BI platform stays disconnected from work
- The knowledge stays with the individual and downstream communication channels.
There are approaches to integrate and productize these decision loops. There was an incredible article that touched upon capturing decision traces and processing those signals at scale. All of the “big data” hoopla re-packed is a big problem for others to tackle. For now, I consciously built my own simple tools, loops and will continue to watch innovation round robin to come back to Snowflake on a regular basis.
Closing the AI, Semantics, and Context Loop in Snowflake
Instead of framing every component in my process, here’s narrowed visual of 2 context loops. This is the contextual shape of my AI BI delivery heading into Q4 2026. It will look different again by Q1 2027 as Snowflake and Claude evolve and improve. This lens on my workflow was built with Claude and Snowflake; no third party technology required.
For these loops to work, you need
- Analytics competency. Part of that competency requires some level of adoption and trust with analytics / BI in your organization.
- Business metrics governance. This is continuous refinement, reconciliation alignment of definitions that drives acceptance and understanding how metrics are expressed and reported.

Understanding Adoption and Utilization: The Data Loop with DataTools Radar
Snowflake ships a strong set of observability tools. Observability gives a structured, narrowly scoped replay of what happened inside Snowflake. That raw data carries real value, but not the direction needed to actually improve the conversational analytics experience. Snowflake’s foundation is flexible enough to build a bespoke layer on top, tuned and contextual. To turn that into actionable intelligence, I built a Streamlit app that runs inside of Snowflake as a simple observability layer that is built for understanding and action instead of displaying log data. It’s not a product or a service, but rather a fast way to browse my Snowflake estate. This tool was vibe coded by voice on my way to the office and it turned out to address most of my basic needs.

Automating Recommendations and Remediation
Understanding what happened is nice. Acting on it immediately is my objective. I measure success, adoption, session success rate, and remediation time.
Snowflake Cortex is earning its keep here: sifting that context and surfacing recommendations stopped me from burning time looking at chat logs. The “Profiled” questions come straight from real conversations, grouped into 48 recurring topics.
This console is my productized proactivity, something Business Intelligence never delivered.

Business Conversational Loop – Chat Feedback Skill
In my setup, Claude remains the business context and action interface. To close this loop, I created a Chat Feedback Skill. Back to my original objective of removing noise and focusing on what is important, I train users to control the feedback loop and submit feedback when:
- They have to re-direct the agent because information is “wrong”
- They feel the response is not credible.
- Information is missing from available data
- Errors / disconnects and other issues
The Snowflake agent receives a request to a Chat Feedback Tool . Cortex processes that feedback using a stored procedure. The skill itself shares back to the Claude user exactly what is being prepared as immediate feedback loop. That preserves psychological safety and governance that only the issue itself is captured. I have 100% participation because everyone understands this is a structured way for continuous improvement.
In my multi-agent setup, the business conversation happens in Claude, because that’s where the work already happens. The analytics + governance is designed to protect that flow for accuracy and governance purposes.

As you can see, the output of this skill gives the analytics engineer in Snowflake actionable guidance directly. On average 8 out of 10 logs are fed into Claude Code / Cursor and result in immediate remediation with no adjustments before landing in my CI process. I have been experimenting how to deliver full remediation loops, but I prefer to have full control and enough observations before automating.

Building Conversational Analytics on an Agile AI BI Foundation
BI architects build durable systems meant to answer a wide range of questions, including ones not yet asked. Semantic models give builders, and now LLMs, coverage, context, and a declarative path into governed data. All of that work is extremely important. A dimensional model should exist for foundational metrics around which an enterprise is built.
From that foundation is a need for business events and dynamics that influence those metrics. Sometimes at the speed of business (same day) and sometimes retrospectively when enough time passes. That tension between a tightly governed structure and a continuously evolving business is imperfect by nature. Trying to perfect it is defying nature. Adapting to what is most important and predictive is where progress happens. I see the new wave of vendors tackling these problems with a deep understanding of what plagued BI and am always on the lookout for those that actually address what happens when AI Analysts are the norm.
The data platform I choose first remains Snowflake. It remains my preference for now because it works for both small, medium and large enterprises. For my initiative I already had a DBT repo that evolved into a mono-repo that holds:
- dbt transformation pipelines / process
- dbt models (fact and dimension tables, business views / marts)
- snowflake semantic models
- tests / validation
- artifacts for skills
- a version controlled metrics glossary (managed from DataTools Pro)
- docs
- continuous integration code
I do however, use and integrate multiple data platforms, including PostHog (runs on Clickhouse) into my agent deployment approach. I reject the idea that all data and semantics need to exist in one place with one standard to reach a fictious point of clarity and understanding.
Evolving that Foundation with Snowflake Semantic Layer
My early success using AI to do descriptive statistics work didn’t require a semantic layer. I simply converted and refined my BI semantic layer into a highly detailed metrics glossary, that was originally built to automatically extract and govern metrics that originate in Salesforce. Here is the natural evolution for context curation that started 18 months ago and reached production in June of 2026.
Gen 1- Claude + CSV files (from Snowflake export) and metrics glossary and prompt
Gen 2 – Claude + CSV files (from Snowflake export) metrics glossary, ontology (entities), information categories and analysis
Gen 3 – Claude + Agent Skill (industry summary) + CSV + (from Snowflake export)
Gen 4 – Claude + Agent Skill + Cortex Skill + Snowflake Semantic Layer + CI-CD + first evaluation
Gen 5 – This article covers where I landed in my Gen 5 configuration as I work on the next evolution.
What I Learned Building Conversation Analytics?
Traditional BI and and semantic layers is not enough to deliver conversational analytics at the speed business leaders want to move.
- Semantic layers offered across most platforms still don’t have the depth, curation and governance to scale conversational analytics agents beyond simple foundations.
- Understanding conversations require capturing the entire context of a conversation without storing the entire conversation itself. This is occurring outside of the data platform. Convincing an executive that has adopted Claude or Chat GPT better be an order of magnitude better.
- Delivery and training of agents is not the same as apps and BI dashboards.
- The best early adopters of conversational analytics need to have a higher than average data literacy
Distribution
Vertical integration with embedding agents inside of Slack and Teams is one tactic that I think will play a big part to activate consensus based decisions. That is more relevant in larger enterprises. My experiments operationalizing agents in Slack have not gone so well.
Business Context Curation
Building conversational analytics is an exercise of curating context, packaging the collective knowhow and continuously improving and refining that process along.
What’s Next?
There are other skills listed in my diagram that I will cover in future articles and a whitepaper I wrote in June when we reached production readiness. Hopefully this lengthy retrospective had some nuggets of knowledge for folks working through the same challenges. I am not available for consulting / services but always happy to hop on a quick chat with anyone working on these same problems.




















