The State of the Database Landscape

The 2024 industry report from Redgate includes data from every sector and every company size, from developers, DBAs and software delivery professionals to IT leaders, CTOs and CEOs across the world.

Methodology

  • 3849 respondents
  • 6 continents
  • 15 industry sectors

Database DevOps

Database DevOps is now mainstream

Database DevOps, the practice of automating and streamlining database development and including it into DevOps workflows for application development, has come of age.

As far back as 2018, it was called out in the Accelerate State of DevOps Report from DORA as a key technical practice which can drive high performance in DevOps. It found that integrating database development into software delivery positively contributes to performance, and changes to the database no longer slow processes down or cause problems during deployments.

Since then, it has moved on from being a tempting proposition to becoming standard practice in development teams. Quite simply, if you’re not doing it now, you could be losing out on the advantages it brings.

 

Methodology

The drivers for adoption

Top of the list when considering Database DevOps is, predictably, increasing the speed of delivery in order to release value to the business faster. There are many other advantages to be gained, however, from minimizing application downtime and freeing up developers for more added value work through to increasing the protection of production databases and meeting audit and compliance requirements.

What are the main drivers for automating the delivery of database changes as part of a wider DevOps process?

  • To increase the speed of delivery of database changes (46%)
  • To minimize application downtime (34%)
  • To free up developer time for more added value work (34%)
  • To enable faster resolution of issues (30%)
  • To reduce risk of losing data during deployments (30%)
  • To facilitate collaboration between Dev and Ops (29%)
  • To increase protection of production databases (28%)
  • To meet audit or regulatory requirements more easily (20%)

Database DevOps adoption rates

73% of respondents in The State of the Database Landscape Survey stated they have already adopted Database DevOps across all or some of their projects, or are planning to do so in the next two years. This finding is a significant highlight because it demonstrates that the understanding of the advantages of DevOps has filtered down from application development to database development.

It’s also a major signal that those with slower plans or no plans to adopt DevOps for database development will fall behind their competitors by not gaining the same advantages across their business.

Have you adopted Database DevOps practices which integrate database changes into the DevOps process?

  • Already adopted across some projects (31%)
  • Plan to adopt across some / all projects in next two years (25%)
  • Already adopted across all projects (17%)
  • Not adopted and no plans to adopt within next two years (14%)
  • Unsure (10%)
  • I don't know what 'DevOps' means (3%)

The challenges for adoption

That’s not to say there are no challenges when integrating database changes into the DevOps process. For nearly two thirds (59%) of survey respondents, the challenge centers around aligning application and database development into one workstream, or synchronizing the changes in development. Another third are more concerned about protecting data and meeting security and compliance requirements.

All of these cases stress the importance of integrating database development processes with those of application development by, for example, using the same version control, continuous integration and continuous development practices and tools. Doing so overcomes different development approaches while also providing the audit measures necessary to demonstrate regulatory compliance.

What are the greatest challenges when integrating database changes into a DevOps process?

  • Overcoming different approaches to application and database development (31%)
  • Synchronizing application and database changes (28%)
  • Preserving and protecting business-critical data (21%)
  • Meeting security or compliance concerns (16%)
  • Keeping up with the speed of delivery of applications (5%)

The challenges implementing across multiple teams

A typical way to introduce DevOps is to start with one team, demonstrate the advantages to be gained, and then roll it out across multiple teams. We see the same kind of issues arising when this happens.

Once again, skillset and knowledge gaps appear, alongside integration with existing processes and standardization and alignment. These are followed by coordination, version control strategies and a cultural resistance, indicating a reluctance to change workflows.

That said, there are rewards waiting for those who introduce Database DevOps. Big rewards in terms of how fast teams can deploy database changes into production environments once DevOps is in place.

What are the challenges when implementing Database DevOps across multiple teams?

  • Skillset and knowledge gaps (33%)
  • Integration with existing processes (30%)
  • Standardization and alignment (30%)
  • Communication and coordination (25%)
  • Version control and branching strategies (22%)
  • Cultural resistance (21%)
  • Data security and compliance (19%)
  • Continuous integration and deployment (18%)
  • Scalability performance (17%)
  • None (8%)

The rewards of adoption

Nearly a third (31%) of survey respondents reported that they deploy changes to production in one business day or less. The same question was asked in Redgate’s 2021 Database DevOps Survey, at which time only 19% did so. So there has been an increase of around 50% in those teams who can now confidently release database changes. As importantly, 40% of respondents in 2021 were taking one month or more to deploy changes to production, and this has now fallen to 28%.

All of which is a good indicator that, as organizations overcome the challenges of adopting Database DevOps, they can release changes faster. An important point to note here is that when integrated into the same DevOps workstreams for application development, using the same tools and processes, Database DevOps also enables organizations to keep their data safe.

What is the average time for database changes to be deployed to production

Less than one business day
  • 2021 (10%)
  • 2023 (18%)
One business day
  • 2021 (9%)
  • 2023 (13%)
One week
  • 2021 (26%)
  • 2023 (22%)
Two weeks
  • 2021 (14%)
  • 2023 (18%)
One month
  • 2021 (21%)
  • 2023 (13%)
Three months
  • 2021 (13%)
  • 2023 (8%)
Six months
  • 2021 (4%)
  • 2023 (6%)
A year or more
  • 2021 (2%)
  • 2023 (1%)

31%Almost a third (31%) of organizations now release changes to production in one business day or less, compared to a fifth (19%) two years ago

The obstacles to adoption

The biggest obstacle to implementing DevOps for over two thirds of the survey responders appears to be a skills and knowledge gap. 42% cite a lack of skills in the team, and a further 29% cite a lack of understanding of DevOps in general. Alongside this, there is a fear of disruption to existing workflows and a lack of alignment between development and operations teams.

What is more worrying here is that it appears to be underpinned by the lack of awareness of benefits to the business, the lack of budget to invest in new tooling, and the lack of support from executive leadership. This calls for refreshed thinking among the C-level and IT management as well as development teams.

What are the main obstacles when implementing a DevOps approach?

  • Lack of appropriate skills in the team (42%)
  • Disruption to existing workflows/business (34%)
  • Lack of understanding of DevOps in general (29%)
  • Lack of alignment between Dev and Ops teams (27%)
  • Lack of awareness of benefits to the business (25%)
  • Lack of budget to invest in new tooling (25%)
  • Lack of support from executive leadership (19%)

42%Among 42% of organizations, the biggest obstacle to adopting Database DevOps is a lack of appropriate skills and knowledge gaps