Koen Verbeeck in General Analytics A gentle introduction to dbt In a typical data warehouse project, data is loaded, transformed and stored into a data store using an ETL (extract... 10 December 2024 12 min read
Dennes Torres in Blogs Microsoft Fabric: Moving Dataflows Gen 2 to different workspaces Dataflows Gen 2 are not supported by source control and deployment pipelines yet. When we need to promote a dataflow... 17 July 2024 2 min read
Ben Johnston in Blogs Warehouse Load Patterns – Part 2 – Load Patterns This continues and finishes my two-part series on warehouse load patterns. There are many methods to transfer rows between systems... 31 December 2023 29 min read
Ben Johnston in Blogs Warehouse Load Patterns – Part 1 – Requirements and General Patterns No matter the ETL tool used, there are some basic patterns to follow when transferring data between systems. There are... 26 November 2023 28 min read
Blogs Dennes Torres in Blogs Power BI: ETL or not ETL, that’s the question ETL stands for Extract, Transform, and Load. Dennes Torres explains what an ETL tool is and isn't.… 07 March 2022 5 min read
Blogs Dennes Torres in Blogs Data Factory: Use a SQL Query to create a Data Source When we include a data source inside a data flow it always requests a dataset. The dataset, in turn, requires... 01 November 2021 2 min read
Blogs Dennes Torres in Blogs 5 SSIS tricks you would like to know How to make conditional decisions in a package It may seems strange the lack of a decision task for the... 30 August 2021 3 min read
Blogs Dennes Torres in Blogs Identity column vs ETL Process Creating ETL process can pose so many challenges we will only fully discover them when really building the ETL. Before... 01 March 2020 6 min read
Blogs Dennes Torres in Blogs Merging tables in Power BI dataflows with PRO subscription Power BI dataflows is a powerful self-service ETL tool. However, some features demand the use of Power BI Premium, way... 03 October 2019 2 min read
Matthew Skelton Database Lifecycle Management for ETL Systems Few databases are self-contained. They take data from other sources, and publish them to downstream consumers of data. These ETL... 16 March 2016 32 min read
Richard Morris Chet Ramey: Geek of the Week The BASH shell is the most popular UNIX command-line scriptable shell. It became the inspiration for PowerShell. As with so... 14 December 2015 10 min read
Nicolas Prigent PowerShell Day-to-Day Admin Tasks: Monitoring Performance By reading performance counters from services such as SQL Server or Exchange, you can get a wealth of performance information.... 01 July 2015 13 min read
Adam Aspin SQLXML Bulk Loader Basics SQLXML isn't exactly new technology, but like the even more venerable BCP, it remains the quickest and most reliable way... 02 June 2015 26 min read
Dennes Torres Optimizing Batch Process in SQL Server SQL Server batch processes are usually run from SQL Agent in background. They can take significant time and resources, especially... 08 May 2015 32 min read
Feodor Georgiev How to get ETL Horribly Wrong ETL ( Extract, transform, load) doesn't have to be like a spell on hell. To make a success of ETL... 09 January 2015 14 min read
Robert Sheldon Microsoft’s Log Parser Utility: Swell ETL For loading text, CSV or XML files into SQL Server, the Log Parser utility, with its amazing SQL engine, is... 12 November 2013 21 min read
Nigel Rivett The ETL from Hell – Diagnosing Batch System Performance Issues Too often, the batch systems that underlie a lot of database processing just grow without conscious design. When runs start... 15 October 2013 17 min read
Eugene Philipov Comparing multiple rows insert vs single row insert with three data load methods The performance of 'extract, transform, load' (ETL) processes for large quantities of data can always be improved by objective testing... 21 February 2013 15 min read
Feodor Georgiev Administrating SQL Server Integration Services – Planning, Documenting and Troubleshooting SQL Server Integration Services is an essential component of SQL Server, and designed to perform a variety of routine and... 12 December 2011 15 min read
Richard Morris Geek of the Week: Linus Torvalds For Windows programmers, Linus Torvalds work has suddenly become relevant. No, we don't mean Linux, but Git. This distributed Source... 17 October 2011 15 min read
