DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
HubSpot'tan Salesforce'a veri taşırken External ID, upsert ve ilişki sırası: Geliştirici notları
korayyalcin profile

HubSpot'tan Salesforce'a veri taşırken External ID, upsert ve ilişki sırası: Geliştirici notları

#crm #salesforce #dataengineering #api
Comments 1
8 min read
PNG to JPEG saved 15-63% on a full-page screenshot, depending on the page. Cropping beat both.
fetchsmith profile

PNG to JPEG saved 15-63% on a full-page screenshot, depending on the page. Cropping beat both.

#webscraping #api #javascript #dataengineering
Comments
4 min read
What Breaks When You Migrate Petabytes: A Field Guide
prajaktashende profile

What Breaks When You Migrate Petabytes: A Field Guide

#database #aws #googlecloud #dataengineering
1
Comments
4 min read
Thought Experiment: If 100GB of structured/3D data could be losslessly compressed to 1GB, what would you build?
japanopendatalab profile

Thought Experiment: If 100GB of structured/3D data could be losslessly compressed to 1GB, what would you build?

#discuss #architecture #dataengineering #database
Comments
3 min read
Data Engineer Resume: How to Show Scale, Reliability, Cost
resuhive profile

Data Engineer Resume: How to Show Scale, Reliability, Cost

#career #dataengineering #resume #jobsearch
1
Comments
4 min read
Auto Loader and Structured Streaming on Azure Databricks: Checkpoints, Schema Evolution, and Exactly-Once
karanpulyala profile

Auto Loader and Structured Streaming on Azure Databricks: Checkpoints, Schema Evolution, and Exactly-Once

#databricks #pyspark #dataengineering #azure
Comments
6 min read
Events In, Answers Out: One Pipeline From Kafka Stream to Iceberg Table
charanrachumalla profile

Events In, Answers Out: One Pipeline From Kafka Stream to Iceberg Table

#kafka #flink #dataengineering #streamprocessing
Comments
3 min read
I found a jean at 6 euros on a 46 euro market. The deal was the easy part. published: false
bpx13303 profile

I found a jean at 6 euros on a 46 euro market. The deal was the easy part. published: false

#webscraping #monitoring #dataengineering #automation
Comments
3 min read
DuckDB vs Spark: which workloads actually need a cluster
mohammed_arshadansari_f2 profile

DuckDB vs Spark: which workloads actually need a cluster

#dataengineering #database #python #data
Comments
3 min read
Pazarlama olaylarını sunucuda toplamak: Bir geliştiricinin kontrol listesi
korayyalcin profile

Pazarlama olaylarını sunucuda toplamak: Bir geliştiricinin kontrol listesi

#analytics #webdev #dataengineering #privacy
Comments
3 min read
I Registered Fresh Accounts on 5 Amazon Scraper APIs and Ran the Same Test on All of Them
pangolinfo profile

I Registered Fresh Accounts on 5 Amazon Scraper APIs and Ran the Same Test on All of Them

#webscraping #dataengineering #api #python
1
Comments
8 min read
Your BI Quote Is Really a Data Quote
seven_billion_ffd761d9574 profile

Your BI Quote Is Really a Data Quote

#businessintelligence #dataengineering #analytics #budgeting
Comments
2 min read
Faster Pip Installs in Python Docker Images With BuildKit Cache Mounts
aniketsoni profile

Faster Pip Installs in Python Docker Images With BuildKit Cache Mounts

#docker #python #cicd #dataengineering
2
Comments
4 min read
The real work in a data agent is the harness around it
jacob_baruch_2a2aec3f6e3c profile

The real work in a data agent is the harness around it

#ai #dataengineering #analytics #data
Comments
6 min read
How to assess AI data readiness for one business workflow
openlock1377 profile

How to assess AI data readiness for one business workflow

#ai #dataengineering #consult
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.