{"id":103437,"date":"2024-08-08T18:50:45","date_gmt":"2024-08-08T18:50:45","guid":{"rendered":"https:\/\/www.red-gate.com\/simple-talk\/?p=103437"},"modified":"2024-09-03T20:04:42","modified_gmt":"2024-09-03T20:04:42","slug":"microsoft-fabric-using-lakehouse-data-in-real-time-dashboards","status":"publish","type":"post","link":"https:\/\/www.red-gate.com\/simple-talk\/blogs\/microsoft-fabric-using-lakehouse-data-in-real-time-dashboards\/","title":{"rendered":"Microsoft Fabric: Using Lakehouse data in Real Time Dashboards"},"content":{"rendered":"<p>Real-Time dashboards are a great feature in Real Time Intelligence experience to monitor our data. However, by default it&#8217;s made to work only with Kusto Databases. The options to create a real time dashboard or to define its data source only accept Kusto Databases.<\/p>\n<p>What if we would like to see in real time the information we have in a lakehouse as well? Let&#8217;s discover a solution for this.<\/p>\n<h2>The Magic Solution: Shortcuts<\/h2>\n<p>We can create shortcuts in a Kusto database pointing to lakehouse tables. This will allow us to query lakehouse tables using KQL from the Kusto databases.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"577\" height=\"394\" class=\"wp-image-103438\" src=\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2024\/08\/a-screenshot-of-a-computer-description-automatica.png\" alt=\"A screenshot of a computer\n\nDescription automatically generated\" \/><\/p>\n<p>There are some limitations in relation to what we can do with shortcuts in a Kusto Database, but this doesn\u2019t prevent us to build real time dashboards using the shortcuts.<\/p>\n<p>In fact, if needed, we can build a Kusto database only for this purpose: Create shortcuts to lakehouse to allow including the queries into a real-time dashboard. This is useful in scenarios where we may not be using real-time ingestion to Kusto databases, but we still would like the real-time dashboard to show information as soon its ingested in the lakehouse.<\/p>\n<h2>Pin to Real Time Dashboard<\/h2>\n<p>After creating the shortcuts, the next steps are as usual for the creation of real-time dashboards. We can execute a KQL query in a query set and use the Pin to Dashboard button.<\/p>\n<p>Remember: it needs to be in a query set, not directly in the Kusto Database. The option \u201cPin to dashboard\u201d is not available when we use the Kusto Database directly.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"999\" height=\"572\" class=\"wp-image-103439\" src=\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2024\/08\/a-screenshot-of-a-computer-description-automatica-1.png\" alt=\"A screenshot of a computer\n\nDescription automatically generated\" \/><\/p>\n<p>We can choose between creating a new dashboard or adding the query to an existing one.<\/p>\n<h2>Creating Alerts from the Real Time Dashboards<\/h2>\n<p>The last and most powerful step is the creation of alerts with Data Activator. From the Real Time dashboard, we can do this and it&#8217;s very interesting how we are extending all these features to lakehouse tables.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"340\" height=\"902\" class=\"wp-image-103440\" src=\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2024\/08\/a-screenshot-of-a-computer-description-automatica-2.png\" alt=\"A screenshot of a computer\n\nDescription automatically generated\" \/><\/p>\n<h2>References<\/h2>\n<ul>\n<li><a href=\"https:\/\/www.red-gate.com\/simple-talk\/blogs\/real-time-intelligence-more-than-a-name-change\/\">Real-Time Intelligence: More than a name change<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=qs-YZfMX_58\">Fabric Monday 42: Taking Actions from your data<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=k5SSeRg6OJU\">Fabric Monday 43: The Multiple Flavours of Data Activator and Real-Time Dashboard<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=HoivJMCk1nk\">Fabric Monday 44: Using Parameters in Real Time Dashboards<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=wikHAQRoVFQ\">Fabric Monday 45: Drill-Through in Real-Time Dashboards<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=2T1rvb-3250\">Fabric Monday 46 : Interaction in Real Time Dashboard<\/a><\/li>\n<\/ul>\n<h2>Summary<\/h2>\n<p>The possibility to expand real-time features to lakehouses is a powerful workaround<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Real-Time dashboards are a great feature in Real Time Intelligence experience to monitor our data. However, by default it&#8217;s made to work only with Kusto Databases. The options to create a real time dashboard or to define its data source only accept Kusto Databases. What if we would like to see in real time the&#8230;&hellip;<\/p>\n","protected":false},"author":50808,"featured_media":103442,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[2,159164],"tags":[158997],"coauthors":[6810],"class_list":["post-103437","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blogs","category-microsoft-fabric","tag-microsoft-fabric"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/posts\/103437","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/users\/50808"}],"replies":[{"embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/comments?post=103437"}],"version-history":[{"count":2,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/posts\/103437\/revisions"}],"predecessor-version":[{"id":103444,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/posts\/103437\/revisions\/103444"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/media\/103442"}],"wp:attachment":[{"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/media?parent=103437"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/categories?post=103437"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/tags?post=103437"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/coauthors?post=103437"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}