27 February 2018
27 February 2018

SQL Provision adds fully integrated data masking

Karis Brummit announces SQL Provision, which combines SQL Clone's fast, lightweight database copying and centralized management of provisioning, with Data Maskers's ability to obfuscate sensitive or personal data, prior to distribution.

SQL Provision launched in January, offering users blazingly fast database copying, with a light storage footprint, centralized management, and the ability to mask any sensitive data, prior to distribution.

This new release takes compliant provisioning one step further, by integrating data masking directly into SQL Clone’s image creation process, rather than running it as a separate step prior to the image creation.

Having defined your masking set, you can ensure that SQL Clone will apply it during image creation, and then create all clones from the sanitized image. This means that you can be confident that all clones distributed outside of a secure ‘production’ environment will comply with requirements for pseudonymizing and obfuscating sensitive and personally-identifying data.

The Need

Many organizations have adopted DevOps practices for the database, to help them make more effective use of the data they collect, for business analysis, as well as for faster development, effective testing, and ultimately to enable them to deploy reliable databases at the frequency they need.

However, in many cases, advances in an organization’s ability to collect and analyze data have outstripped advances in their data governance procedures, which are supposed to ensure that sensitive data remains protected and secure as it travels outside the production environment.

While legislation such as GDPR and HIPAA refer to data minimization as a way limiting the use of data to the purpose for which data was collected, this doesn’t mean an organization needs to avoid using their data entirely. However, it does mean they must have a process to sanitize any sensitive or Personally Identifiable Information (PII), prior to distributing data around the business. The whole process will need to be automated, and auditable so that it complies with national and industry regulations.

The Challenge

Organizations need an effective “gateway” between production and non-production environments, to ensure the safe distribution of database copies, from one secure and centrally-managed location. The challenge is in designing this gateway efficiently, such that that it protects data, but without blocking the team’s development and release processes and without introducing an unrealistic administration burden.

As described in our previous article, a traditional, manual process for distributing sanitized database copies is no longer fit for purpose. The process is difficult to audit, it does not scale, and the administrative burden is considerable.

The Solution

SQL Provision offers a different approach to the problem, and we’re continually developing it to become the ideal ‘gateway’ tool between production and non-production environments.

SQL Clone uses virtualization technology within Windows to provide the fast, lightweight database copying component, with centralized management of all data movement.

Data Masker provides effective data obfuscation and anonymization. We define the required set of data masking rules once, describing how each column and row should be obfuscated and anonymized. We can even define rules across tables, to maintain existing relationship in the data, so that the masked data will look and behave as much like the real data as possible, for development and testing purposes. We can then apply the masking set consistently to the target database, every time we need to distribute a fresh copy.

What’s New?

In the initial release of SQL Provision, data masking was still an additional step. We had to restore a database backup, run Data Masker, and then use SQL Clone to create the image from the masked database, and manage provisioning.

With this new release, users can now run masking sets within SQL Clone, as an integral part of the image creation process. This shortens the workflow, removing the need to perform a database restore prior to image creation, and so makes the provisioning process much quicker, and uses less disk space.

We simply ‘drag-and-drop’ into the image creation process the required data masking sets. We can also run other T-SQL Script to change configuration settings and permissions.

SQL Clone applies them all, in sequence, during the image creation process, ensuring that all clones created from the resulting image are correctly and consistently sanitized. As always, the entire process can be scheduled and automated using PowerShell

Database Provisioning for Compliance

This release of SQL Provision both supports the DevOps approach to database development and testing, and makes data protection more central to the process. Managing provisioning from one central system is more transparent, consistent, repeatable and auditable.

This SQL Provision integration is supported by Data Masker v6.0 and SQL Clone v2.5.0. If you’ve not yet tried SQL Provision, download your free 14-day trial now to get started.

Tools in this post

GDPR

Deliver GDPR-compliant data to SQL Server teams

Find out more

You may also like

  • Article

    A Database Developer's Guide to SQL Clone

    Phil Factor explains how SQL Clone works, and its multiple benefits when used in daily development and testing work, as well as for other tasks such as training staff to use a new application.

  • Article

    Managing Data Masking Rules in Larger Teams using Source Control

    What if you have several people in the team who are responsible for data security across your databases, and they need to work together to develop and maintain the data masking configurations, which must then be applied consistently as part of an automated provisioning process? How should they do it? The solution turns out to be simple: source control.

  • Article

    Easing the transition from shared to dedicated database development

    Working in dedicated development environments for the database is the ideal for many. This is the message we frequently hear throughout the industry from thought leaders, at conferences, and in many written pieces about implementing best practices. Yet 70% of developers still work in shared environments, as highlighted in the 2020 State of Database DevOps

  • Article

    SQL Clone for Unit Testing Databases

    Phil Factor demonstrates how to use SQL Clone to create 'disposable' SQL Server databases, for development and testing work. You can spin up a clone, use it to unit test your code, messing up the clone in the process, then reset the clone in seconds, ready for the next test.

  • Article

    SQL Provision and Azure SQL Database: Creating Local Development and Test Databases

    As more businesses start to use cloud-based platforms, such as Azure SQL Database, as their primary database solution, they find that they still need to support on-premise workflows for development and test databases. This is a perfect task for SQL Provision.