Dataflows Gen 2 are the new version of Power BI dataflows. There are so many changes in relation to the previous version they are considered a new feature. The main difference is the possibility to set a target for the result of each query in the dataflow. In this way, it can be used as … Read more
The animation on the top of this article tries to track the evolution of the enterprise architecture since SQL Server 7.0 introduced tools for ETL, Semantic model and much more. Some of you probably remember these tools as SSIS and SSAS. At that time they had even older names, but no one wants to confess remembering … Read more
No matter the ETL tool used, there are some basic patterns to follow when transferring data between systems. There are many data tools and platforms, but the basic patterns remain the same. This focuses on SQL Server, but most of these methods work in any data platform. Even if you are using a virtualization layer, … Read more
comp A few weeks ago, I wrote a blog about Database Projects for Microsoft Fabric. It’s an interesting advance, but it was disappointing because it was only available in half. Updating the Fabric Data Warehouse was not possible yet. The November updates for Microsoft Fabric announces the support for SQLPackage, but I couldn’t find additional … Read more
Microsoft Fabric, including the Data Warehouse, evolves faster than we can analyze and write about it. Here I’m summarizing the most recent news I looked at. Clone Table We have a specific statement to clone a table. But what exactly does it mean? The Clone Table feature promises to create an image of the table … Read more
Database Projects for Fabric Data Warehouse is one of the most recent news of Fabric for SDLC (Software Development Life Cycle). Microsoft released the Database Projects around 2010 and have they evolved since that year. The original name was a tool called SSDT, released as part of SQL Server, but running inside a Visual Studio … Read more
Microsoft Fabric was first announced during Microsoft BUILD. Since then, I’m publishing content about Microsoft Fabric, creating an interesting sequence of content. In this blog, I’m summarizing the content I published about Fabric, helping you to navigate on this content. Main Articles As you may have noticed, there is one article about concepts, one about … Read more
Loading On-Premises and external data is a fundamental need for a Data Platform such as Microsoft Fabric. However, during this preview stage, Microsoft Fabric brings many surprises (and, should I say, deceptions?) in this area. This blog may explain a lot, but I’m not bringing conclusions, but lot of questions. It will be a pleasure … Read more
After the great announcement of Microsoft Fabric this week, it’s time to get a trial and start playing with this great product. Microsoft Fabric is a very broad product, so it requires some additional configuration for the start of a trial. Configuring the Tenant By default, the Power BI tenants are disable for Microsoft Fabric. … Read more
.In this blog I will illustrate how we can ingest data from a blob storage to a Microsoft Fabric Data Warehouse using T-SQL. Create a new workspace On the left ribbon, click Workspaces. Click the New Workspace button. Provide a name for the workspace. On advanced configuration, ensure you choose Premium by Capacity, and you … Read more
Synapse is a great data lake house tool. This means in a single tool we have resources to manage a data lake and data warehouse. The Synapse Serverless Pool is great to manage data lakes and for a great price: around us$ 5,00 for each TB of data queried. This makes it a great choice. … Read more
Once upon a time, we got the Data Warehouse concept. A concept as great as difficult to implement. The definition of this concept may surprise you nowadays: the Data Warehouse is a collection of structured and unstructured data. The structured data is what we usually know, but what happened to the unstructured data on this … Read more