DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
State, Not Events: Keeping a Kafka Topic Forever With Log Compaction

State, Not Events: Keeping a Kafka Topic Forever With Log Compaction

1
Comments 1
4 min read
Consistent hashing explained: the trick that keeps a cluster calm when a node joins or dies

Consistent hashing explained: the trick that keeps a cluster calm when a node joins or dies

Comments
14 min read
Keep three percentage denominators visible in a signal cross-tab

Keep three percentage denominators visible in a signal cross-tab

Comments
3 min read
Design Dropbox: the file storage and sync system design walkthrough

Design Dropbox: the file storage and sync system design walkthrough

Comments
19 min read
Design a CDN: the content delivery network system design walkthrough

Design a CDN: the content delivery network system design walkthrough

Comments
19 min read
Design Yelp: the proximity-search system design walkthrough

Design Yelp: the proximity-search system design walkthrough

Comments
20 min read
Design a real-time analytics system: the stream-processing walkthrough

Design a real-time analytics system: the stream-processing walkthrough

Comments
19 min read
Data Engineering Log 1/3: Introduction to Data Engineering

Data Engineering Log 1/3: Introduction to Data Engineering

Comments
2 min read
Design Pastebin: the beginner-friendly system design interview walkthrough

Design Pastebin: the beginner-friendly system design interview walkthrough

Comments
17 min read
Change Data Capture (CDC) Explained: From the Transaction Log to a Snowflake MERGE

Change Data Capture (CDC) Explained: From the Transaction Log to a Snowflake MERGE

1
Comments 1
6 min read
Design an ad click aggregator: the system design interview walkthrough

Design an ad click aggregator: the system design interview walkthrough

Comments
19 min read
Retail Media Incrementality in Python: What a Synthetic Holdout Can (and Cannot) Tell Us

Retail Media Incrementality in Python: What a Synthetic Holdout Can (and Cannot) Tell Us

Comments
5 min read
Introduction to Machine Learning: A Practical Beginner Guide for Beginners

Introduction to Machine Learning: A Practical Beginner Guide for Beginners

1
Comments
4 min read
Bank statement PDF parsing: make each exported row possible to check

Bank statement PDF parsing: make each exported row possible to check

Comments
4 min read
"What breaks if this column changes?" Building LineageGate on FalkorDB

"What breaks if this column changes?" Building LineageGate on FalkorDB

Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.