Azure: Grids, Hubs, Busses, Topics, and Queues… Oh My!

Messaging between application components and devices is why engineers invented computer networks. The ultimate computer network is the Internet, which has practically connected all the world’s devices to a single network where any one device can send a message to another device. For this reason, there are tons of solutions that provide messaging infrastructure to…

Azure Databricks Series - Part 6
Batch and Streaming Pipelines

One of the best features of Databricks is that it facilitates transitioning batch pipelines to streaming pipelines. Depending on your transformation logic it may be as easy as changing two lines of code. In this post we will review some batch and streaming concepts and show how to write a notebook that can be run…

Databricks Batch and Streaming

Databricks is a leading big data processing service available on Azure. One of the nicest features in Databricks is the ability to develop workloads that run in batch or streaming modes. In this webinar, we’ll review the basics of a notebook running in batch mode. In this example, we’ll be focusing on Delta Tables for…

Azure Databricks Series - Part 5
Databricks Jobs

Today’s post will cover Databricks Jobs. There is also the concept of a Spark Job which will be covered briefly to try to avoid confusion. Spark Job When running a Spark application there is the concept of a Spark job. At runtime, the Spark driver converts your Spark application into a job that is transformed…

Optimizing Compute on Azure Kubernetes Services (AKS)

AKS is a versatile tool, capable of running all kinds of workloads. Because of this, it makes no assumptions about the kind of jobs it will be running and gives the controls to the user to figure out the best compute model for the workload. In this webinar, we’ll look at those controls and how…

Migrating Data Workloads from SQL to Azure Synapse

You’ve heard about the advances in the Azure Synapse Analytics service. Microsoft has brought together data integration, enterprise data warehousing, and big data analytics. In this webinar, we’ll review the fundamentals of Azure Synapse Analytics and why it may be the right choice for you. Both serverless and dedicated resource consumptions models will be covered.…

Azure Databricks Series - Part 3
Workspaces & Notebooks

Now that you’ve instantiated the Databricks service within Azure, let’s take a tour of the workspace & become familiar with Notebooks. Workspace The above image shows the Databricks homepage of this workspace. The left menu provides the majority of your options (outside of administration). Clicking on Workspace expands to the following: The workspace is divided…

SQL in Azure Container Instances

Cloud computing challenges IT professionals to think about compute apart from storage so we can have limitless scalability. For some, thinking about SQL Server without hardwired storage and database is a difficult concept to grasp. In this session, you will learn how to implement a microservice ETL using a containerized SQL Server. You’ll also learn…

Azure Databricks Series - Part 1
Intro to Azure Databricks

Many companies today have aging data architectures. As you look to modernize your traditional ETL pipeline, there is a tool you should keep in mind: Azure Databricks. During your move into Azure, there will probably be a place for Azure Databricks. In the past, general DTS/SSIS pipelines and SQL Server engines were sufficient but with…

Azure Migrations - Part 4
Database Migration Assistant Assessment

Azure offers a lot of options for moving SQL databases from SQL Server to Azure. Knowing which choice is the best choice for your database can sometimes be challenging. Microsoft provides a tool, the Database Migration Assistant, that assesses your database to show you if it is compatible or not. And what changes you may…