The year is 1999, somewhere in Cambridge, UK. Kathi, a member of the Data-Philes team, is reading a memo sent from her manager. The memo talks about someone who disrupted a project management meeting in London. He claims he is from 20 years in the future. Chris walks in. Chris: Kathi, have you seen the … Read more
Robert Sheldon discusses the challenges involved with including the database in the DevOps pipeline and how to overcome them in Database DevOps. … Read more
As database changes are added to the DevOps pipeline, database unit testing becomes crucial. In this article, Adam Hafner describes unit testing and how it applies to databases.… Read more
A good day for a database administrator (DBA) is a lot like a good airline flight. A lot of excitement in either situation is bad. In a perfect world, a DBA will be productive and not spending most of their time “putting out fires.” (And fires are never a good idea on a flight!) DBAs … Read more
Today I got a bit closer to a meaningful definition of automation as it applies to the software development process. I’ve been turning this concept over in my head for a while, which is partly related to the dreaded question of licensing. Why should licensing an automation product be related to the number of users? … Read more
If you have worked with databases long enough, you probably have many frightening stories to tell about things that have gone awry on the job or problems that were difficult to solve. Accidently dropping a table or trying to fix an issue with the CIO standing right in your cube, repeatedly asking if you’ve fixed … Read more
Communication is the foundation of DevOps. Grant Fritchey tells the tale of a project that failed because of previous communication and trust issues between the DBA and development teams. … Read more
I’ve been speaking a lot on the topic of DevOps lately, and there’s a question I like to ask. What is the purpose of your organization? I get all kinds of answers. “We make software that delights our customers and makes their jobs easier.” “Our company makes low-cost widgets. “ “We make the best gizmos … Read more
I hear from a lot of database administrators who are worried about being automated out of a job. These kinds of worries are not new. Over the course of my career, I’ve seen CTOs outsource large groups of IT jobs to different regions around the world to save money. IT has long been regarded as … Read more
Unit testing and even Test-Driven Development is possible for databases. In this article Samuel Nitsche makes the case for introducing unit tests to your database development, and suggests some lightweight ways to get started.… Read more
If your development team needs to work on anonymised copies of the current production database, and if changes are being delivered rapidly as well, that could mean a lot of time and routine DevOps work copying databases. SQL Clone was designed for tasks like this. Grant Fritchey investigates whether you save time, effort and scripting over the more traditional approach, and at what point it makes sense to use it.… Read more
Database code analysis will reduce the number of 'code smells' that creep into your database builds. It will alert the team to mistakes or omissions, such as missing indexes, that are likely to cause performance problems in production. It will allow the Governance and Operations team visibility into production readiness of the code, warning them of security loopholes and vulnerabilities. William Brewer describes the two technical approaches to database code analysis, static and dynamic, and suggests some tools that can help you get started.… Read more
Database Lifecycle Management aims to make the development and modification of databases more predictable. Bugs are the source of more unpredictability than anything else, purely because it is so difficult to guess how long it will take to fix them. Good testing at all stages may take some time and effort, but it greatly reduces likelihood of the wildcard factor of the bug that is first detected during the deployment process; or worse, that gets into the production release.… Read more
Although the techniques of Database Lifecycle Management can reduce the timescales for the delivery of new functionality to business systems, what if the database 'layer' consists of several large interdependent databases and data flows with replication and audit? Does DLM scale to this level of complexity? Margaret Cruise O'Brien starts a series of articles that describes the practicalities of improving DLM within an existing framework and team supporting a multi-database multi-server system, by describing some of the database management problems and solutions in an enterprise-scale database.
… Read more
When there are several SSIS projects with packages in a SQL Server Database or Data Warehouse development, automated deployments as part of Continuous Integration can get tricky. Nat Sundar describes how he created a Deployment script that is intended to provision a Data Warehouse for System Integrated testing (SIT).… Read more
If you are introducing DevOps workflows into a large organization, you’ll need to plan carefully and prioritize tasks, adapt, maintain a thick skin, communicate constantly, and ensure that all teams have a chance to contribute their solutions. Bob Walker explains how FCSA set up a DevOps Workgroup, its philosophy and its goals for improving database and application deployment processes.… Read more
SSIS was not originally designed with automated deployment in mind. However, any database that uses SSIS projects and their packages needs a way of scripting the deployment of them if the database is to be deployed rapidly, or via a build server. Nat Sundar shows a technique that can be extended to manage the scripted deployment of SSIS projects. … Read more
Identifying a need for better collaboration between teams is only the first step to introducing DevOps workflows into your organization. You also need to define a common DevOps goal, a strategy to achieve it, and then to break down this strategy into series of manageable tasks for each team. Bob Walker describes how Farm Services of America started to "do DevOps".… Read more
Subscribe for more articles
Fortnightly newsletters help sharpen your skills and keep you ahead, with articles, ebooks and opinion to keep you informed.
Compliant Database DevOps
Standardize team-based development
Automate database deployments
Monitor performance and availability
Protect and preserve data
