Struggling with Industrial Data?

Resources Check out the complete code on GitHub. Browse the GX Data Doc on Azure Blob Storage. Use Case Last week I explored Soda as a data quality testing framework for my large enterprise client. This week I’m exploring a more mature alternative called Great Expectations or GX in short. GX generates neat HTML reports called Data Docs that give an overview of your data quality test results. The client wants to share these reports with the team - but not with the world!...

Use Case For my current engagement I’m tasked with developing an automated data quality framework for a large industrial enterprise in the renewable energy sector. The client has over a hundred independent SCADA systems from various vendors gathering energy production data. All this data has to flow in one central repository to be analyzed with Databricks. The client is obligated to ensure high data quality for contractual reporting to external parties....

I often work from WeWork, which is a public co-working space with a shared WIFI-network. Securing my connection For security and privacy reasons, I therefore work behind a VPN. I purchased an AirPVN subscription and configured it as an OpenVPN connection in NetworkManager1: NetworkManager’s terminal user interface nmtui This way, even if I’m working from Prague, my location will always be shown as Belgium2. This was important because my current enterprise client’s IT-security team kept receiving alarms that my location was changing all over Europe....

This week at Smart Metals Podcast, we, the hosts Luke van Enkhuizen and Denis Gontcharov, had a conversation about the critical role of domain knowledge in the metals industry, particularly in the context of increasing automation and AI. We delved deeper into the challenges of preserving expertise in a digital age and the potential future of factories. If your current challenge is balancing domain knowledge with technological advancements, then listen to this episode when you have a moment....

In this episode of the Smart Metals Podcast, host Luke van Enkhuizen and co-host Dennis Gontcharov delve into Luke’s journey from welder to consultant for the metalworking industry. The discussion covers the challenges faced by metalworking companies in digital transformation and provides practical advice on how they can become more efficient and meet customer demands. Luke highlights the importance of creating a strategic plan, understanding customer needs, and ensuring comprehensive training for staff to effectively implement digital solutions....

This week at Metal Connect, we, the hosts Denis Gontcharov and Luke van Enkhuizen, had a conversation about digital transformation in the aluminum industry. We delved deeper into Denis’s journey from an aluminum process engineer to a data consultant and the unique challenges and opportunities of digital transformation in this sector. If your current challenge is navigating digital transformation in the aluminum industry, then listen to this episode when you have a moment....

In this episode of the Smart Metals Podcast, hosts Dennis Gontcharov and Luke van Enkhuizen explore the challenges and common pitfalls of digitalization in the metals manufacturing sector. They discuss the high failure rate of digital transformation initiatives, the difficulty in transitioning from pilot projects to full-scale implementation, and the absence of comprehensive digital strategies with a focus on data infrastructure and quality. The conversation addresses the misalignment between IT and OT departments, the drawbacks of relying on legacy solutions, and the essential role of a unified data strategy in breaking down operational silos....

Navigating Digital Transformation in Multi-Site Enterprises. Do you struggle with managing digital transformation across multiple factories in different countries? Navigating cultural and technological disparities can be tricky. Let’s explore how enterprise manufacturers can overcome these challenges for successful multi-site deployments. In this episode of the Smart Metals Podcast, hosts Luke van Enkhuizen and Denis Gontcharov delve into the complex world of digital transformation across multi-site enterprises. They discuss the challenges and opportunities of deploying a unified digital strategy either top-down or bottom-up, exploring the pros and cons of each approach....

In this debut episode of the Smart Metals Podcasting Show, hosts Luke van Enkhuizen and Denis delve into the world of Industry 4.0, focusing on the critical shift from data science to data engineering within industrial environments. Denis shares his journey from a data scientist to a data engineer, sparked by the challenge of accessing and preparing data for analysis in the metal industry. He highlights the insufficiency of current systems to support the data analytics needed for Industry 4....