Microsoft Fabric: Using Lakehouse data in Real Time Dashboards

Comments 0

Share to social media

Real-Time dashboards are a great feature in Real Time Intelligence experience to monitor our data. However, by default it’s made to work only with Kusto Databases. The options to create a real time dashboard or to define its data source only accept Kusto Databases.

What if we would like to see in real time the information we have in a lakehouse as well? Let’s discover a solution for this.

The Magic Solution: Shortcuts

We can create shortcuts in a Kusto database pointing to lakehouse tables. This will allow us to query lakehouse tables using KQL from the Kusto databases.

A screenshot of a computer

Description automatically generated

There are some limitations in relation to what we can do with shortcuts in a Kusto Database, but this doesn’t prevent us to build real time dashboards using the shortcuts.

In fact, if needed, we can build a Kusto database only for this purpose: Create shortcuts to lakehouse to allow including the queries into a real-time dashboard. This is useful in scenarios where we may not be using real-time ingestion to Kusto databases, but we still would like the real-time dashboard to show information as soon its ingested in the lakehouse.

Pin to Real Time Dashboard

After creating the shortcuts, the next steps are as usual for the creation of real-time dashboards. We can execute a KQL query in a query set and use the Pin to Dashboard button.

Remember: it needs to be in a query set, not directly in the Kusto Database. The option “Pin to dashboard” is not available when we use the Kusto Database directly.

A screenshot of a computer

Description automatically generated

We can choose between creating a new dashboard or adding the query to an existing one.

Creating Alerts from the Real Time Dashboards

The last and most powerful step is the creation of alerts with Data Activator. From the Real Time dashboard, we can do this and it’s very interesting how we are extending all these features to lakehouse tables.

A screenshot of a computer

Description automatically generated

References

Summary

The possibility to expand real-time features to lakehouses is a powerful workaround

Load comments

About the author

Dennes Torres

See Profile

Dennes Torres is a Data Platform MVP and Software Architect living in Malta who loves SQL Server and software development and has more than 20 years of experience. Dennes can improve Data Platform Architectures and transform data in knowledge. He moved to Malta after more than 10 years leading devSQL PASS Chapter in Rio de Janeiro and now is a member of the leadership team of MMDPUG PASS Chapter in Malta organizing meetings, events, and webcasts about SQL Server. He is an MCT, MCSE in Data Platforms and BI, with more titles in software development. You can get in touch on his blog https://dennestorres.com or at his work https://dtowersoftware.com