DZone.com Feed

Automating Monolith Migration for Resource-Constrained Edge Systems (Thu, 01 Jan 2026)
We usually design microservices with a cloud-first mindset. If a container needs more RAM, we scale it up. If latency increases, we add a cache or a load balancer. But the world is shifting toward Software-Defined Vehicles (SDVs) and edge computing. In these environments, hardware is fixed, and latency can be a matter of life and death (e.g., autonomous braking systems). Migrating a legacy C/C++ monolith to microservices in this context is dangerous. The overhead of containerization (Docker) and inter-process communication (IPC) can easily overwhelm an embedded CPU.
>> Read More

LLMs in Data Engineering: How Generative AI is Changing ETL and Analytics (Thu, 01 Jan 2026)
For decades, data engineering has revolved around building reliable pipelines to extract, transform, and load (ETL) data, ensuring that business analysts and data scientists have access to trustworthy datasets. The role has always focused on scale, reliability, and speed. But with the rise of large language models (LLMs), the traditional definition of ETL and analytics is shifting. Generative AI is no longer just a research curiosity; it’s becoming a powerful co-pilot in modern data platforms. This article explores how LLMs are impacting ETL and analytics, the opportunities and challenges they create, and what the near future may look like. To make things practical, we’ll refer to a real-world case in which a global retailer used LLMs to automate parts of its data transformation and analytics pipeline.
>> Read More

Airflow vs. Dagster vs. Prefect: Which Scheduler Fits Your Data Team? (Thu, 01 Jan 2026)
Workflow orchestration sits at the heart of modern data engineering. Whether you’re running daily ETL jobs, streaming pipelines, or machine learning workflows, you need a scheduler to manage dependencies, retries, and monitoring. For years, Apache Airflow has been the default choice, but newer tools like Dagster and Prefect have emerged, each promising a more modern approach. The question is: Which scheduler best fits your data team? In this article, we’ll explore the strengths and trade-offs of Airflow, Dagster, and Prefect through real-world lenses. We’ll focus less on abstract features and more on how these tools behave in practice.
>> Read More

Turning Architectural Assumptions into Enforceable Code (Thu, 01 Jan 2026)
When Everything Works But Nothing Aligns There is a moment in every large AI initiative when the system behaves correctly, the model behaves correctly, and yet the entire pipeline enters a state where nothing aligns with what was promised. The logs look fine. Dashboards look clean. Latency spikes are non-critical. But a design boundary that was agreed upon months earlier no longer maps to the reality the system is operating in. The failure does not originate in code. It originates in the assumptions underneath the code. The incident that pushed me to formalise this came from a simple requirement: the inference layer needed p95 latency under 180 ms during peak loads. Three teams signed off on it. Architecture captured it in diagrams, delivery scoped for it, and infra agreed to provision accordingly. But by the time the model reached production, none of those teams were working off the same interpretation. The latency budget existed. The system no longer matched it.
>> Read More

DevOps Cafe Podcast

DevOps Cafe Ep 79 - Guests: Joseph Jacks and Ben Kehoe (Mon, 13 Aug 2018)
Triggered by Google Next 2018, John and Damon chat with Joseph Jacks (stealth startup) and Ben Kehoe (iRobot) about their public disagreements — and agreements — about Kubernetes and Serverless. 
>> Read More

DevOps Cafe Ep 78 - Guest: J. Paul Reed (Mon, 23 Jul 2018)
John and Damon chat with J.Paul Reed (Release Engineering Approaches) about the field of Systems Safety and Human Factors that studies why accidents happen and how to minimize the occurrence and impact. Show notes at http://devopscafe.org
>> Read More

DevOps Cafe Ep. 77 - Damon interviews John (Wed, 20 Jun 2018)
A new season of DevOps Cafe is here. The topic of this episode is "DevSecOps." Damon interviews John about what this term means, why it matters now, and the overall state of security.  Show notes at http://devopscafe.org
>> Read More