DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Why Athena/Iceberg Tends to Make Code the Spec
gyu07 profile

Why Athena/Iceberg Tends to Make Code the Spec

#dataengineering #iceberg #athena #ai
3
Comments 5
9 min read
Sumeh: one API for data quality across 14 engines
maltzsama profile

Sumeh: one API for data quality across 14 engines

#python #opensource #dataengineering #pyspark
1
Comments 1
4 min read
Kafka Topics, Partitions, and Offsets Explained: The Concepts Every Beginner Confuses
sudoruss profile

Kafka Topics, Partitions, and Offsets Explained: The Concepts Every Beginner Confuses

#beginners #dataengineering #streaming #tutorial
1
Comments
3 min read
Managed Data Lake: A Guide for 2026
jonisar profile

Managed Data Lake: A Guide for 2026

#data #dataengineering #softwareengineering #softwaredevelopment
Comments
20 min read
Zero-Downtime MariaDB PostgreSQL Migration: Why the Usual Tools Fell Short, and How Debezium CDC Solved It
wwr0ngn4m3 profile

Zero-Downtime MariaDB PostgreSQL Migration: Why the Usual Tools Fell Short, and How Debezium CDC Solved It

#database #dataengineering #devops #postgres
Comments
9 min read
Maternity HL7-to-FHIR Pipeline: Bridging Legacy Hospital Messages to Modern Healthcare APIs
budiwidhiyanto profile

Maternity HL7-to-FHIR Pipeline: Bridging Legacy Hospital Messages to Modern Healthcare APIs

#showdev #api #architecture #dataengineering
Comments
12 min read
Your AI Bill Is a Routing Problem, Not a Model Problem
fagundesv profile

Your AI Bill Is a Routing Problem, Not a Model Problem

#ai #data #dataengineering #python
Comments
3 min read
Building a Document Intelligence Pipeline (Or: 80% of Your Data Is in PDFs)
vaibhav7387 profile

Building a Document Intelligence Pipeline (Or: 80% of Your Data Is in PDFs)

#dataengineering #ai #python #architecture
Comments
3 min read
Distributed Metadata Migration
ai_cloud_data_handling profile

Distributed Metadata Migration

#database #dataengineering #distributedsystems #systemdesign
Comments
3 min read
The Math That Explains Why Your Automation Rate Is Stuck at 35%
vaibhav7387 profile

The Math That Explains Why Your Automation Rate Is Stuck at 35%

#architecture #dataengineering #automation #programming
Comments
3 min read
Entity Resolution: Why "Show Me Everything About This Customer" Is So Hard
vaibhav7387 profile

Entity Resolution: Why "Show Me Everything About This Customer" Is So Hard

#dataengineering #database #architecture #ai
Comments
3 min read
Embedded Products: Why the API Is the Easy Part
vaibhav7387 profile

Embedded Products: Why the API Is the Easy Part

#api #architecture #dataengineering #webdev
Comments
3 min read
Your Data Warehouse Didn't Fix Anything (And Why That's Not a Failure)
vaibhav7387 profile

Your Data Warehouse Didn't Fix Anything (And Why That's Not a Failure)

#dataengineering #architecture #database #datascience
Comments
3 min read
The Linux Guide I Wish Someone Had Given Me : The 20% you'll use 80% of the time
anshu_shah profile

The Linux Guide I Wish Someone Had Given Me : The 20% you'll use 80% of the time

#programming #linux #dataengineering #beginners
2
Comments 1
4 min read
PCI DSS 4.0 Just Made Your Staging Database a Liability. Here Is the Fix
jitendra_devabhaktuni_0f1 profile

PCI DSS 4.0 Just Made Your Staging Database a Liability. Here Is the Fix

#ai #database #datascience #dataengineering
Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.