Get Data Into Databricks - AI/BI Genie
Summary
- Natural Language Q&A: AI/BI Genie enables self-service questions in plain English, converting them to SQL queries without requiring SQL knowledge from business users.
- Data-Informed Intelligence: Genie learns from table schemas, SQL queries, dashboards, and user interactions to provide accurate answers specific to your data and business context.
- Governed and Secure: All Genie interactions are fully governed through Unity Catalog, ensuring users only get answers about data they're authorized to access.
Get Data Into Databricks - AI/BI Genie

Try Databricks today: https://dbricks.co/3EAWLK6.
Discover Databricks' AI/BI Genie, a tool designed to enable users to interact with their data through natural language. It highlights three key features:
- Self-service Q&A: Move beyond traditional dashboards by asking questions in plain language and receiving precise answers.
- AI with data intelligence: Genie leverages insights from your data platform, curated expert instructions, and real-time user feedback to provide accurate responses.
- Governed and secure: All interactions are fully governed, adhering to organizational policies via Unity Catalog.
The tool integrates seamlessly with existing data structures, learns from SQL queries and schemas, and continuously improves through user feedback for enhanced accuracy and reliability.
Chapters
0:00Introduction to Genie0:30How Genie works1:29Optimizing Genie3:45Setting up a genie room6:29Genie management tools8:43Interactive Q&A demo
FAQs
How does Genie convert natural language questions into SQL queries?
Genie uses AI and data intelligence to understand plain-text questions, then converts them into SQL queries that run on tables it has access to. It returns results and visualizes them in graphs so users can see trends.
What does Genie learn to provide accurate answers to your specific questions?
Genie builds understanding from table schemas, column comments, existing SQL queries, dashboards, and user feedback. You can further customize your Genie room with instructions about data abbreviations and pre-written SQL for complex queries.
Which BI tools let business users ask questions of data in natural language?
BI tools that let business users ask questions in natural language include Databricks AI/BI Genie, which integrates semantic understanding with data governance to deliver accurate insights. This video demonstrates how Genie understands complex business questions, translates them into SQL, and returns results without requiring technical expertise. The system maintains data security and compliance by enforcing access controls through Unity Catalog.
How can business users ask questions of enterprise data in natural language?
Business users can ask questions of enterprise data in natural language through Databricks AI/BI Genie by simply typing their question, which the system translates into queries against governed data. This video showcases how Genie integrates with multiple visualization and exploration tools to deliver comprehensive answers including charts, trends, and drill-down capabilities. The system learns from user interactions to improve relevance and accuracy over time.
What's the best AI tool for asking questions about company data?
The best AI tool for asking questions about company data is Databricks AI/BI Genie, which combines natural language understanding with strict data governance and audit trails. This video demonstrates Genie's accuracy in understanding complex business questions, its ability to generate optimized SQL queries, and its integration with enterprise security and compliance frameworks. Genie delivers trustworthy, explainable results that business users can confidently act upon.
Full transcript
0:00 Introduction to Genie
Hi everyone I'm a Solutions architect at datab bricks today I'm going to be talking about and demoing one of our services AI bi genie in today's day and age data is an integral part of almost every company out there Enterprises want to democratize data and AI for all of their employees no matter if in a technical or non-technical role that's where Genie comes in Genie is a self-service question and answers tool that lets users ask questions about their data in plain text natural language it then uses Ai and data intelligence to understand the question and convert it into a SQL query that it then runs on tables it has access to Genie will then take the results let the user know the results and easily visualize the results in graph format so the user can see Trends in their data and this is all without needing to know a word of SQL Genie also it has fully governed interactions since it adheres to your policies established in unity catalog like the rest of our data brick services do so how does Genie get accurate answers to your questions firstly the intelligence built in with Genie makes it so Genie can form a baseline understanding of your data through aspects such as table schemas uh which includes column headers comments you've added to your table headers things like that since it can derive and it can understand what your data is about looking at things like this um also looking at SQL queries existing dashboards and so on but on top of this you can actually customize your genie room so that it understands more about your use case and your data one way to do this is by adding instructions which is natural language um you can add rules or just information about your data or expected questions such as for example if you have data with abbreviations maybe you want to let Genie know what the abbreviations stand for so if someone asks a question without using the abbreviation Genie will be able to translate it and knows what they're talking about if you have more complex queries that you're noticing Genie might not be getting the answer to certain questions that are common you can actually take SQL queries uh you know maybe get a technical resource on your company to write the SQL query for certain commonly asked questions and input that into Genie for the question this way not only does Genie know how to answer that question but it can learn from your SQL query for future questions and what you need Genie to do when certain like similar questions are asked and finally Genie is good at asking users for real-time feedback so if at any point Genie is unsure to answer a question or doesn't understand what exactly the user is looking for it will actually prompt another question before giving an answer and it uses that to train itself and get better answers for users so let's dive into our Genie demo so this is my datab bricks console if you scroll down to the SQL section you can find Genie here I've created did a genie room um and demo using a crunch based data set which has information that lets us derive insights such as startup funding Trends Acquisitions investor activity and so on if we scroll down to this icon right here we could see the data that I'm feeding into my genie room so I have five different tables from the crunch based data set that I'm using today before we get into asking questions about Genie room let's go ahead and see how you create a new Genie room so in this tab I went to Genie I hit create new and it got me here so the first thing you put in is a title such as Genie demo here you can put in a description of the genie room you're trying to create this is so this is my description here this is so when people come to your genie room they have a good idea of what it's about and once you know what the data set's about you can have a better idea of what questions you want to ask it then you got to put in your default Warehouse that is the compute that's actually going to run the queries in your genie room when questions are asked tables this is the tables you can pull from your genie room has access to and can pull from of course user access is also accounted for in these things where your user also needs to have access to the data and the genie room but this is more for what tables does your genie room have access to this is an option that lets you enable your users to upload files when asking questions to Genie as well so if you click that it'll ask you for catalog and schema on where you want that saved and finally you can input sample Le questions which which are presented in the new chat window um so when people come to when people come to your genie room they have options and ideas of questions they can ask off the bat to just get their mind flowing about what are things what are insights we can get from your genie room once you do all that you hit save and it'll create your genie room and bring you to something like this which is my created Genie room so first before we actually go into asking questions let's see these different tabs the first one is chats so Genie does remember the different times you've uh chatted with it so if you want to have a continuous conversation and you want to continue asking about questions you asked before you can select a previous chat and you can continue doing that this is the instructions we talked about earlier in the slides where you can add instructions such as only show me the top 10 results for every query you can add uh I'm not going to add any instructions today but that as an example if you have abbreviations like country code you can say that hey the country code is stored in two letters just any information you think it would be valuable for Genie to know or if you notice that hey it's it's just not getting this it doesn't know what this field means you can add it in instructions to get better results here is where if you want to add sample queries you can do that where you can add queries that Genie can learn from I'm not going to do that right now but also SQL functions you can add SQL functions as well from your catalog we looked at data history okay so history is where you can look at the different questions you've asked if you have access uh if the user has access they can rate how Genie did um and you can really use this to monitor how are things going and also sort different results um in the log to see any insights you want to of how your genie queries are going this is benchmarks I haven't run anything but you can add a benchmark to run an evaluation so if you H add Benchmark this is like you can add a question and uh if you do want to add a SQL answer to just see if it gets near that question you can do that this is more for monitoring benchmarking and just if you want to change in your settings you could do that on the last tab so let's go ahead and ask our Genie room a question finally I have some here let's go with which year saw the highest investment activity and see how it responds there we go so this report shows the total investment amounts raised by company summarized by year the results highlighted the top 10 years with the highest total Investments so the top 10 is because I had it in my instructions and it did come through since I did save it so that's great it shows me the top 10 years and it is showing me the trend let me go ahead and put that as a line graph and there we go so it shows how you could do multiple visualizations ask questions you know how you can make Genie better so that is an overview of Genie I hope you enjoyed and let us know if you have any questions
Learn more about the Databricks Data and AI platform.
The information provided herein is for general informational purposes only and may not reflect the most current product capabilities or configurations.