Data analytics has become one of the powerful domains in the world of data science. An enormous amount of data is being generated by each organization in every sector. Computer science has found solutions to store and process this data in a smart way through a distributed file system. One such example is Azure Data Lake. It uses the Hadoop Distributed File System, and to perform analytics on this data, Azure Data Lake storage is integrated with Azure Data Analytics Service and HDInsight. In this article, Suhas Pande will explain how to store data using Azure Data Lake and how to perform data analysis on it using U-SQL, a big data SQL and C# language. … Read more
The AWS Elastic Beanstalk feature is a web application provisioning service that allows you to automatically scale as needed. In this article, Gerald Bauer explains how to set up and configure Elastic Beanstalks through the AWS dashboard and Visual Studio. … Read more
In the third part of his series, Nicolas Prigent describes how to run post-deployment configuration and automation tasks on Azure Virtual Machines. Nicolas explains how to use Azure VM Extensions using the Azure PowerShell module to save time during the provisioning process.… Read more
Azure Storage can store many types of data, from NoSQL tables to VHDs. In this article, Supriya Pande explains how to work with Azure Storage Explorer, a tool that makes it easy to manage storage in Azure. She also provides an example of using the Azure Storage .NET SDK to upload files.… Read more
The Azure Cosmos DB Emulator can be used to develop Cosmos DB applications without a cost for the Azure service. In this article, Suhas Pande demonstrates several common tasks using C# and the emulator: creating databases, collections, and documents.… Read more
Creating resources in Azure, while not difficult, can be time consuming if you use the manual steps. One way to automate the process is by using JSON templates to save time and enforce standards. In this article, Brian Flynn describes how to create JSON templates for deploying a network with virtual machines. … Read more
AWS Serverless Applications allow developers to create apps without needing a server environment. In this article, Gerald Bauer demonstrates how to get started with this technology in C#. He shows how to deploy and test one of the built-in samples and then walks you through how to create your own application. … Read more
In the second part of his series, Nicolas Prigent describes in detail how to automate the login process using PowerShell and Azure CLI. Nicolas also explains how to retrieve information about your Azure subscription.… Read more
Tapping the power of serverless computing via Lambda functions and cloud-native technologies allows us to extend the native capabilities that exist in open-source databases. David Yahalom demonstrates how to create a queue using Lambda that can be used to add queuing capabilities to MySQL.… Read more
As more companies take advantage of the cloud, teams must learn to do the basics in new ways. In this article, Mircea Oprea demonstrates how to migrate an ASP.NET application to Azure and from on-premises SQL Server to Azure SQL Database. He also discusses how to troubleshoot issues you may find during the migration.… Read more
Azure, Microsoft's cloud, provides dozens of services to make cloud development fast without the need to worry about infrastructure such as hardware. In this article, Jakub Kaczmarek explains the benefits and challenges of creating a bot using the Microsoft Bot Framework found on Azure. He also walks you through creating a simple bot.… Read more
IT shops do not want to spend time and energy managing infrastructure and servers as was done in the past. They must conserve resources for the things that add value for the business. Today, it is challenging for companies to automate and configure their Azure infrastructure. In the first part of his new series, Nicolas Prigent introduces the basics about Azure and Windows PowerShell for DevOps and Sysadmin.… Read more
Azure Event Grid (in preview) is a new event routing service that works with Azure Logic Apps and Azure Functions. It’s one more solution that enables developers to focus on business value, not on infrastructure. Christos Matskas explains how this new feature works and walks you through a simple example. … Read more
The key to efficient development is reusability. When developing scripts for administration, being able to restart a script where it left off is also important. Robert Cain shows you how to write functions in PowerShell that have these two qualities for administering Azure.… Read more
This article pulls together the concepts from two previous articles to demonstrate a way to automate the “on-demand” creation and deletion of an HDInsight cluster. This not only serves as a demonstration of the power of automating Azure provisioning, but is a practical solution for the user who only occasionally requires the power of HDInsight for scalable computations.… Read more
Because Azure is designed from the ground-up to allow automated provisioning, It provides a number of interesting opportunities for use. With a .NET language such as C#, it is possible to create a very flexible 'on-demand' infrastructure in Azure, using Azure Resource Manager templates, that allows users to economically deploy the resources they need just for the interval of time that they are required, and then destroy them. … Read more
Your Agile developers want MongoDB, or a similar document database: your Ops people are concerned about security and backup, and Governance are muttering about transactionality and data transfer between systems. Do you restrict your developers from rapidly-evolving the data design for their domain or do you embrace the joys of NoSQL unconditionally? If you accept a polyglot database environment, where the NoSQL lambs coexist with the relational lions, how do you provide tools and common database concepts that everyone can use and understand?… Read more
Azure Data Lake Store is an extendable store of Cloud data in Azure. You can move data to and from Azure Data Lake Store via Azure data Factory or Azure SQL Database and connect to a variety of data sources. You can script upload files from on-premise or local servers to Azure Data Lake Store using the Azure Data Lake Store .NET SDK. Ambily KK shows how easy it is to get started by setting up a script or App to move data to Azure Data Lake Store.… Read more
Azure Data Factory provides a radical new cloud-based way of collecting and preparing data in preparation for its storage and analysis. How do you get started with it to explore the possibilities it provides? Feodor Georgiev shows the practicalities of how to go about the task of preparing a pipeline for use, from preparing the Azure environment to downloading a file from a FTP to a blob storage in the Azure environment… Read more
Cloud-based services and applications must still be monitored just like the on-premise ones. You still need most of your data center activities that ensure that your planning, budgeting, security and service-level obligations are met wherever the data and services are actually hosted. There is much to be said for an integrated approach to providing a unified view of entire application workloads on-premise. hybrid and cloud using the same tools wherever possible. … Read more
Subscribe for more articles
Fortnightly newsletters help sharpen your skills and keep you ahead, with articles, ebooks and opinion to keep you informed.
Compliant Database DevOps
