13 May 2020
13 May 2020

Database Kill and Fill

5
When testing database code in development, you usually have a lot of tests that aim to prove that the various processes such as ETL, reporting or the processing of an order, still work as they always did. If it is a changed process, you need to ensure that, from a known dataset, the process yields … Read more
17 April 2020
17 April 2020

SQL Agent Job Generator: Scheduling A Job

In this last entry in the initial series of posts on building a SQL Agent Job Generator, I am going to add the ability to schedule the jobs that we generated in the previous post. The code that is available here in github: https://github.com/drsqlgithub/SSISDeployTool/tree/e8c44505bba6b3c764531c8b489101b39b5c27a7, is likely sufficient for some smaller organization’s needs with jobs. (Future … Read more
31 March 2020
31 March 2020

Using PowerShell to Control Visio

1
Note: Please be kind on my PowerShell programming techniques. If I am doing something really horrible, let me know. I will change my code. As our team struggles to get to a place where we can do continuous integration, some of the biggest issues we have needed to work on is figuring out how to … Read more
29 March 2020
29 March 2020

Microsoft Data Platform 2020

1
From last November 4 to 8 I have been at PASS Summit in Seattle, attending excellent technical sessions and having the honour to deliver a  lightning session, which is a small 10 minutes presentation. Why should you read this? Being one of the biggest data events in the world, PASS Summit usually exposes the present and … Read more
01 March 2020
01 March 2020

Identity column vs ETL Process

Creating ETL process can pose so many challenges we will only fully discover them when really building the ETL. Before you complain about modelling, the example here has no relation to data warehouse modelling. The ETL in question was a migration from a data source to another. The need for executing multiple times was mainly … Read more
19 February 2020
19 February 2020

Grappling with sp_describe_undeclared_parameters(). The Hows, Whys and Wherefores.

6
sp_describe_undeclared_parameters() promises a great deal, but delivers less. It was added mostly for executing application queries via sp_prepare using a TDS link, but has several quirks and restrictions that rather spoils its more general use. It is designed to provide you with all the parameters of a batch. You might use it when a SQL … Read more
18 February 2020
18 February 2020

Women in Tech – where are you?

0
That’s a strange title I hear you say but it’s an honest question.  I’ve worked in IT now for over 20 years and have got used to working in an office full of men.  In my current role out of about 10 members of the technical team there are 2 of us which, makes it … Read more
17 February 2020
17 February 2020

Using sys.dm_exec_describe_first_result_set_for_object. The Hows, Whys and Wherefores.

5
I’ve been working on a project unkindly nicknamed ‘The Gloop’ because the code is a bit amorphous. Basically, it is an approach to documenting SQL Server databases, using the facilities provided such as the metadata views and DMFs. Although it is relatively simple to record the result returned by a table-valued function I’d rather neglected … Read more
02 January 2020
02 January 2020

Power BI and Excel

4
Power BI and Excel are tools so close to each other that Power BI was born inside Excel. Power Query, Power Pivot, Power View, they were all Excel plugins before being united and become Power BI. The ability to build an ETL, design a model and generate reports and dashboards with great storytelling make Power … Read more