Hosting Great Expectations Data Docs on Azure Blob Storage

Resources Check out the complete code on GitHub. Browse the GX Data Doc on Azure Blob Storage. Use Case Last week I explored Soda as a data quality testing framework for my large enterprise client. This week I’m exploring a more mature alternative called Great Expectations or GX in short. GX generates neat HTML reports called Data Docs that give an overview of your data quality test results. The client wants to share these reports with the team - but not with the world!...

February 20, 2025

Exploring Soda Data Quality Testing on Databricks

Use Case For my current engagement I’m tasked with developing an automated data quality framework for a large industrial enterprise in the renewable energy sector. The client has over a hundred independent SCADA systems from various vendors gathering energy production data. All this data has to flow in one central repository to be analyzed with Databricks. The client is obligated to ensure high data quality for contractual reporting to external parties....

February 14, 2025

Developing a Qtile VPN Widget

I often work from WeWork, which is a public co-working space with a shared WIFI-network. Securing my connection For security and privacy reasons, I therefore work behind a VPN. I purchased an AirPVN subscription and configured it as an OpenVPN connection in NetworkManager1: NetworkManager’s terminal user interface nmtui This way, even if I’m working from Prague, my location will always be shown as Belgium2. This was important because my current enterprise client’s IT-security team kept receiving alarms that my location was changing all over Europe....

February 13, 2025

Energy Monitoring to comply with the German Energy Efficiency Act (EnEfG)

This article was written for the United Manufacturing Hub Energy monitoring can help you comply with the Energy Efficiency Act (EnEfG), mandating energy-intensive companies, public institutions, and data centers to monitor and reduce their energy consumption. Read the article to learn more! On 21 September 2023, the German government passed the Energy Efficiency Act (EnEfG). Energy-intensive companies, public institutions, and data centers must monitor and, where possible, reduce their energy consumption....

July 2, 2024

Industrial IoT visualization: Why United Manufacturing Hub chose Grafana to power its IIoT platform

Article written for Grafana and the United Manufacturing Hub in cooperation with Jeremy Theocharis. Most IT professionals are familiar with Grafana as a visualization tool to monitor IT telemetry data, such as CPU consumption. Grafana is also, however, a powerful tool for industrial IoT (IIoT) — which is why our team at United Manufacturing Hub (UMH), a startup that provides an open source industrial IoT platform for enterprise manufacturers, chose to leverage Grafana in our core product....

July 1, 2024

Cloud-Native Technologies on the Edge in Manufacturing

This article was written for the United Manufacturing Hub in cooperation with Jeremy Theocharis and is based on the presentation given by Jeremy Theocharis at Cloudland 2024. Connecting a USB stick to the “cloud” seems to be a stupid thing to do. Yet, it is something that we must do if we want to increase the efficiency of our world’s production and therefore reduce CO2. Nearly every factory in the world—whether they’re churning out cars, energy, shampoo, or just about anything else—still operates on technology from the 90s....

June 26, 2024

NAMUR Open Architecture versus Unified Namespace: Two sides of the same coin?

Article written for the United Manufacturing Hub. Why do we need the Unified Namespace if we already have the NAMUR Open Architecture? In this article, we compare the Unified Namespace (UNS) and NAMUR Open Architecture (NOA). First, we highlight that they both extend the traditional automation pyramid to enable industrial Internet of Things (IIoT). Second, both architectures outline a highly-reliable IT infrastructure. Third, both architectures are applicable to operate in manufacturing, chemical and pharma, all very conservative industry that are slow to adopt new technical innovations....

June 5, 2024