Data generation is the science and art of providing data for database development work that is as realistic and controllable as possible. The skills of generating realistic data are an essential part of being a database developer. It is important: you need plenty of data of exactly the right type, size and verisimilitude in order … Read more
Sails.js is a robust web development framework that runs on top of Node.js and uses JavaScript’s asynchronous features to speed up the production of applications. Its adherence to the Model-View-Controller (MVC) architecture, which simplifies feature separation and code organization, is a critical component of its attractiveness. Rapid application development is facilitated by Sails.js’ pre-built components … Read more
XML is a common storage format for data, metadata, parameters, or other semi-structured data. Because of this, it often finds its way into SQL Server databases and needs to be managed alongside other data types. Even though a relational database is not the optimal place to store and manage XML data, it is often needed … Read more
A load balancer is a tool used to distribute the traffic (client requests) to multiple servers on which the applications are deployed so that the response time of the application can improve by spreading the work across multiple servers. Consider an application that needs to serve images to the clients’ requests concurrently. By design it … Read more
With so many technology publications and news sites, and so many stories appearing each day, it can be hard to keep up with what’s going on out there. To help you stay on top with what’s happening, here’s a roundup of some fascinating tech stories from the last month or so. Make your vote really … Read more
Part of a series: [ Part 1 | Part 2 | Part 3 | Part 4 ] In the previous posts in this series, I described how I have optimized a long-running set of routines by processing databases, tables, and even subsets of tables in parallel. This leads to many separate jobs that all kick … Read more
This article is about how to create Kubernetes Deployments and Services using YAML files and Kubectl. You will also learn how to containerize and deploy any containerized application to Kubernetes. We will create a basic React.js application, containerize it using Docker, and then deploy it to Kubernetes using the Kubernetes Deployment YAML file. We will … Read more
One of the many ways a relational table differs from the file structures used by pre-relational storage systems is that the tables, rows and columns can have constraints on them. This allows you to reduce the types of bad data that can be loaded into your tables. This lets the database do a lot of … Read more
In the realm of relational databases, MySQL stands out as one of the most popular choices. Maximizing its performance is crucial, especially in highly concurrent environments where multiple transactions compete for resources. InnoDB, the default storage engine for MySQL, employs a technique known as Multi-Version Concurrency Control (MVCC) to address concurrency needs and enhance performance. … Read more
Star ratings have always been an interesting thing on the Internet. They can be a way to encourage interaction with creators, shopping locations, etc. However, they can also be a bit of trouble as well. Since I started as the editor of this website, I have noticed a few things that have led to us … Read more
In the previous parts of these MySQL optimization series, we told you how query optimization works on a high level, then walked you through how you should optimize queries that insert, read, or update data. Remember the laws of physics? “What goes up, must come down”? Translated into database terms, that means “the data that … Read more
Part of a series: [ Part 1 | Part 2 | Part 3 | Part 4 ] In part 2 of this series, I showed an example implementation of distributing a long-running workload in parallel, in order to finish faster. In reality, though, this involves more than just restoring databases. And I have significant skew … Read more
Over the years Power BI has evolved into a complex and varied ecosystem of tools and solutions, which in its turn demands several supporting roles: there are, of course, developers, data engineers and data scientists, but there is need for one more, i.e. a capacity administrator. Of course some of these roles may be covered … Read more
Containerization has removed boundaries that limit developers from working on one application using different systems. Thus, boosting developer collaboration and speeding the application deployment process. Containerization involves bundling and packaging applications into containers that have all the necessary dependencies and tools for compiling an application on any operating system. Containers enable the coexistence of legacy … Read more
Over the past years, “traditional” ETL development has morphed into data engineering, which has a more disciplined software engineering approach. One of the benefits of having a more code-based approach in data pipelines is that it has become easier to build metadata driven pipelines. What does this mean exactly? Say for example you need to … Read more
The presentation layer of a headless CMS is separated from the content management system itself, making it a backend-only system for managing, creating, and storing material. Content presentation (how the content is shown on websites or applications) and content creation are handled by the content management system in a standard CMS. Headless CMSes have evolved … Read more
There was a time, when I was in a team that was designing an important IT system for a multinational bank, the testers arranged for perfectly normal office workers from the bank to try the system out. This was long before the days of instant video. The software team watched from behind a two-way mirror. … Read more
In the previous articles this series, I demonstrated various ways to retrieve document data from a MongoDB database, using both MongoDB Shell and MongoDB Compass. In this article, my focus shifts from retrieving data to updating data, which is an essential skill to have when working with MongoDB. Whether you access the data directly in … Read more
Before I started as the editor of Simple Talk, I worked on SQL Server. Only. (Ok, I used Redgate’s tools too). But when I started here, one of the goals was to stretch the topics farther and farther into more and more data platforms. And it is not just me in my niche job that … Read more
There are many packages and tools that you can use to facilitate your API development with Rust. Rust has a rich third-party ecosystem of crates for building APIs, including web packages like Actix and Rocket and ORMs like Diesel and SeaORM. This article delves into using Actix and Diesel to build web applications. You’ll learn … Read more