DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Your AI Agent Probably Belongs in the Data Pipeline

Your AI Agent Probably Belongs in the Data Pipeline

Comments
6 min read
MQTT brokers and UNS plumbing: 8 side-by-side comparisons

MQTT brokers and UNS plumbing: 8 side-by-side comparisons

Comments
2 min read
Data Engineering Log 3/3: Data Storage and Queries

Data Engineering Log 3/3: Data Storage and Queries

Comments
1 min read
A backfill can match row counts and totals while still being wrong

A backfill can match row counts and totals while still being wrong

Comments
4 min read
To SQL or to Python; there is another problem

To SQL or to Python; there is another problem

Comments
6 min read
BETWEEN can double-count a fact at an SCD2 version boundary

BETWEEN can double-count a fact at an SCD2 version boundary

Comments
4 min read
An old event timestamp can still leak future information into training data

An old event timestamp can still leak future information into training data

Comments
4 min read
A deleted CDC row still needs a version: a Python counterexample

A deleted CDC row still needs a version: a Python counterexample

Comments
4 min read
Data platform teams are becoming exception handlers

Data platform teams are becoming exception handlers

Comments
7 min read
Stripe reconciliation: carrying September into October

Stripe reconciliation: carrying September into October

Comments 4
4 min read
Proving a parsed brokerage statement: the cash check and the position check in Python

Proving a parsed brokerage statement: the cash check and the position check in Python

Comments
4 min read
Parsing money in Python: reject bad precision before choosing how to round

Parsing money in Python: reject bad precision before choosing how to round

Comments
4 min read
Replaying payment events: test the second run, not just the first

Replaying payment events: test the second run, not just the first

Comments
2 min read
Your SQLite backup restored. Does its checkpoint still match the data?

Your SQLite backup restored. Does its checkpoint still match the data?

Comments
4 min read
Turning Reddit threads into RAG-ready Markdown

Turning Reddit threads into RAG-ready Markdown

Comments 1
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.