Creating Intelligent Bots Using the Microsoft Bot Framework

Azure, Microsoft's cloud, provides dozens of services to make cloud development fast without the need to worry about infrastructure such as hardware. In this article, Jakub Kaczmarek explains the benefits and challenges of creating a bot using the Microsoft Bot Framework found on Azure. He also walks you through creating a simple bot.… Read more

Azure and Windows PowerShell: The Basics

IT shops do not want to spend time and energy managing infrastructure and servers as was done in the past. They must conserve resources for the things that add value for the business. Today, it is challenging for companies to automate and configure their Azure infrastructure. In the first part of his new series, Nicolas Prigent introduces the basics about Azure and Windows PowerShell for DevOps and Sysadmin.… Read more

Questions About Amazon Data Migration Service (AWS DMS) That You Were Too Shy to Ask

Can you imagine it? You are in a group of smart database people, and they are debating the finer points about AWS DMS, and you don't even know what the letters stand for. You just feel too shy to ask those basic questions that seem ridiculous once you're up to speed. Laerte Junior answers all the questions you need answers for when facing the prospect of getting familiar with Amazon's useful Database Migration Servic… Read more

Automating Azure: Creating an On-Demand HDInsight Cluster

This article pulls together the concepts from two previous articles to demonstrate a way to automate the “on-demand” creation and deletion of an HDInsight cluster. This not only serves as a demonstration of the power of automating Azure provisioning, but is a practical solution for the user who only occasionally requires the power of HDInsight for scalable computations.… Read more

Automating Azure: How to Deploy a Temporary Virtual Machine Resource

Because Azure is designed from the ground-up to allow automated provisioning, It provides a number of interesting opportunities for use. With a .NET language such as C#, it is possible to create a very flexible 'on-demand' infrastructure in Azure, using Azure Resource Manager templates, that allows users to economically deploy the resources they need just for the interval of time that they are required, and then destroy them. … Read more

The Quick and the Dead Slow: Importing CSV Files into Azure Data Warehouse

Although Azure Data Warehouse is part of the bright new jewellery of the Microsoft Data Platform, the old Data Warehouse rules still apply where data imports are concerned. When it comes to data import, it pays to choose the fastest import method first and prepare your data first to ensure that it is compatible with your choice. The subtlety is in the details, as Feodor explains.… Read more

Questions About RDS SQL Server That You Were Too Shy to Ask

There are a number of different ways that you can host SQL Server. RDS SQL Server, for example, uses SQL Server within AWS as a simple database service, much like a more versatile alternative to MySQL. Obviously, it is a compromise, in that you lose many of the extras beyond the database. Laerte Junior answers those questions about RDS that people seem to assume you know the answers to, but which you may be too shy to ask.… Read more

Mixing MongoDB and Relational Databases in the Enterprise

Your Agile developers want MongoDB, or a similar document database: your Ops people are concerned about security and backup, and Governance are muttering about transactionality and data transfer between systems. Do you restrict your developers from rapidly-evolving the data design for their domain or do you embrace the joys of NoSQL unconditionally? If you accept a polyglot database environment, where the NoSQL lambs coexist with the relational lions, how do you provide tools and common database concepts that everyone can use and understand?… Read more

Using the Copy Wizard for the Azure Data Factory

Creating a feed for a data warehouse used to be a considerable task. Now, it just takes a few minutes to work through a series of screens that, in this example, create a pipeline that brings data from a remote FTP server, decompresses the data and imports the data in a structured format, ready for data analysis. The Copy Wizard for the Azure Data Factory is a great time-saver, as Feodor Georgiev explains.… Read more

Azure Resource Manager (ARM) Templates

If you need a way of deploying infrastructure-as-code to Azure, then Azure Resource Manager (ARM) Templates are the obvious way of doing it simply and repeatedly. They define the objects you want, their types, names and properties in a JSON file which can be understood by the ARM API. Ed Elliott takes the mystery out of a simple means of specifying your Azure environment, whether it is a VM with blockchain software, SQL Server or a Web App on Linux with PostgreSQL … Read more

Uploading Files to Azure Data Lake Using a .NET App

Azure Data Lake Store is an extendable store of Cloud data in Azure. You can move data to and from Azure Data Lake Store via Azure data Factory or Azure SQL Database and connect to a variety of data sources. You can script upload files from on-premise or local servers to Azure Data Lake Store using the Azure Data Lake Store .NET SDK. Ambily KK shows how easy it is to get started by setting up a script or App to move data to Azure Data Lake Store.… Read more

Creating a Custom .NET Activity Pipeline for Azure Data Factory

Azure Data Factory provides a radical new cloud-based way of collecting and preparing data in preparation for its storage and analysis. How do you get started with it to explore the possibilities it provides? Feodor Georgiev shows the practicalities of how to go about the task of preparing a pipeline for use, from preparing the Azure environment to downloading a file from a FTP to a blob storage in the Azure environment… Read more

Pseudonymization and the Inference Attack

It is surprising that so much can be identified by deduction from data. You may assume that you can safely distribute partially masked data for reporting, development or testing when the original data contains personal information. Without this sort of information, much medical or scientific research would be vastly more difficult. However, the more useful the data is, the easier it is to mount an inference attack on it to identify personal information. Phil Factor explains.… Read more