When testing database code in development, you usually have a lot of tests that aim to prove that the various processes such as ETL, reporting or the processing of an order, still work as they always did. If it is a changed process, you need to ensure that, from a known dataset, the process yields … Read more
With everything that’s been going on in the world recently and all events being cancelled or postponed you might mistakenly think that people’s ability to learn and stay in touch would dissipate. You couldn’t be more wrong. User Group Meetup Hub I am the UK Regional Mentor for PASS which means that I’m the go-to … Read more
The old measurements of length, area, volume and weight in the UK and the States refuse to die. They are known as the Imperial and US customary measurement systems respectively. Not only are they a natural way of dealing with approximate measurements, and tied to human dimensions, but they are no longer difficult to calculate. … Read more
In this last entry in the initial series of posts on building a SQL Agent Job Generator, I am going to add the ability to schedule the jobs that we generated in the previous post. The code that is available here in github: https://github.com/drsqlgithub/SSISDeployTool/tree/e8c44505bba6b3c764531c8b489101b39b5c27a7, is likely sufficient for some smaller organization’s needs with jobs. (Future … Read more
In this entry in the SQL Agent Job Generator system series, we are going to turn the corner and actually start producing working SQL Agent jobs. We will start with simple, standalone T-SQL jobs, that you can kick off or schedule (and that is how I have labeled them, as scheduled since that is how … Read more
In the previous entry in this series, I implemented Environment Variables that will let me have one code base that can easily generate jobs in DEV, PROD, or whatever environment you desire. In this entry, we are going to implement the basic building blocks of the process. I will build: A file with defaults for … Read more
As a relative neophyte to PowerShell (something I will remind readers of every time I start a blog in this series!), I am not always sure I have the best way of doing things. In this blog, I am going to lay a bit of foundation for my job creation system, by building a set … Read more
Note: Please be kind on my PowerShell programming techniques. If I am doing something really horrible, let me know. I will change my code. As our team struggles to get to a place where we can do continuous integration, some of the biggest issues we have needed to work on is figuring out how to … Read more
From last November 4 to 8 I have been at PASS Summit in Seattle, attending excellent technical sessions and having the honour to deliver a lightning session, which is a small 10 minutes presentation. Why should you read this? Being one of the biggest data events in the world, PASS Summit usually exposes the present and … Read more
Creating ETL process can pose so many challenges we will only fully discover them when really building the ETL. Before you complain about modelling, the example here has no relation to data warehouse modelling. The ETL in question was a migration from a data source to another. The need for executing multiple times was mainly … Read more
Graph structures are something that I have lightly covered in my Database Design book in the last few book editions (the last coinciding with SQL Server 2016), implementing them with relational tables. In the next edition of my book that I am starting to write now, my goal will be to cover one of the … Read more
sp_describe_undeclared_parameters() promises a great deal, but delivers less. It was added mostly for executing application queries via sp_prepare using a TDS link, but has several quirks and restrictions that rather spoils its more general use. It is designed to provide you with all the parameters of a batch. You might use it when a SQL … Read more
That’s a strange title I hear you say but it’s an honest question. I’ve worked in IT now for over 20 years and have got used to working in an office full of men. In my current role out of about 10 members of the technical team there are 2 of us which, makes it … Read more
I’ve been working on a project unkindly nicknamed ‘The Gloop’ because the code is a bit amorphous. Basically, it is an approach to documenting SQL Server databases, using the facilities provided such as the metadata views and DMFs. Although it is relatively simple to record the result returned by a table-valued function I’d rather neglected … Read more
This script will copy out all the tables from one version of a database in native BCP format, and place them in a directory of your choice, but defaulting to your user area in a directory called BCPFiles. They are placed in sub directories based on your server name and database name, just to keep … Read more
Boy does time fly, and it is already mid January. The holidays flew by, and now the Christmas tree and (most of) the Christmas décor has been boxed up in the attic (yeah, there is a Santa on a shelf staring at me that he needs to be put up!). The college bowl games are … Read more
Power BI and Excel are tools so close to each other that Power BI was born inside Excel. Power Query, Power Pivot, Power View, they were all Excel plugins before being united and become Power BI. The ability to build an ETL, design a model and generate reports and dashboards with great storytelling make Power … Read more
You know what it’s like, you are running a service pack on SQL Server and 99.9% of the time it all runs smoothly but that odd 0.1% of the time when it doesn’t is usually in the middle of the night with no one around to call on. Well to spare you some pain I’ve … Read more
Here, in this blog, I’m continuing a theme that I started in a previous blog, ‘What’s in that database? Getting information about routines’. In that blog, I just wanted to provide a few examples of extracting metadata from SQL Server into Powershell and hinting about why one might want to do it. I’ll now show … Read more
There is a lot of information held in SQL Server metadata about your SQL Server procedures, triggers, views and functions. Some of it is valuable, other nuggets are useful and a few are rather dull but worthy. It really all needs to be tied together to tell the full story, especially if you are not … Read more
Simple Talk Bloggers
Subscribe for more articles
Fortnightly newsletters help sharpen your skills and keep you ahead, with articles, ebooks and opinion to keep you informed.
Compliant Database DevOps
Standardize team-based development
Automate database deployments
Monitor performance and availability
Protect and preserve data
