Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
PySpark Caching on Azure Databricks: cache() vs persist() vs checkpoint(), the Disk Cache, and When Caching Hurts
Karan Pulyala
Karan Pulyala
Karan Pulyala
Follow
Oct 25
PySpark Caching on Azure Databricks: cache() vs persist() vs checkpoint(), the Disk Cache, and When Caching Hurts
#
databricks
#
pyspark
#
spark
#
dataengineering
1
 reaction
Comments
Add Comment
6 min read
Moderation
AI-Driven Dynamic Pricing in Hotels: A Data Engineer's Deep Dive
Martin Tuncaydin
Martin Tuncaydin
Martin Tuncaydin
Follow
Oct 25
AI-Driven Dynamic Pricing in Hotels: A Data Engineer's Deep Dive
#
dynamicpricing
#
hotelrevenuemanagement
#
aiinhospitality
#
dataengineering
Comments
Add Comment
7 min read
Moderation
Your Fuel Plan Uses One Diesel Price. Europe Publishes 42,323.
Roman Kotenko
Roman Kotenko
Roman Kotenko
Follow
Oct 29
Your Fuel Plan Uses One Diesel Price. Europe Publishes 42,323.
#
logistics
#
api
#
dataengineering
#
opendata
Comments
1
 comment
11 min read
Moderation
A vendor bar for a day nothing traded - why our completeness check was 97% wrong
Alex B
Alex B
Alex B
Follow
Oct 29
A vendor bar for a day nothing traded - why our completeness check was 97% wrong
#
datascience
#
dataengineering
#
finance
#
python
Comments
1
 comment
3 min read
Moderation
Data makes the call: 4 sports, 4 lessons for tech teams
KWAN
KWAN
KWAN
Follow
Oct 29
Data makes the call: 4 sports, 4 lessons for tech teams
#
datascience
#
dataengineering
#
python
Comments
Add Comment
11 min read
Moderation
AWS Glue Job Bookmarks Explained: Build Incremental ETL Pipelines with PySpark
certificationmantra
certificationmantra
certificationmantra
Follow
Oct 26
AWS Glue Job Bookmarks Explained: Build Incremental ETL Pipelines with PySpark
#
aws
#
dataengineering
#
tutorial
#
python
1
 reaction
Comments
1
 comment
7 min read
Moderation
Best Cron Service for Scheduled Data Cleanup: A Delivery Guarantee Comparison
LunarBreeze4173085
LunarBreeze4173085
LunarBreeze4173085
Follow
Oct 25
Best Cron Service for Scheduled Data Cleanup: A Delivery Guarantee Comparison
#
scheduling
#
dataengineering
#
payments
Comments
Add Comment
6 min read
Moderation
Como aprendi Apache Spark — Parte 5: Joins — Shuffle, Broadcast e estratégias de execução
renanpyd
renanpyd
renanpyd
Follow
Oct 24
Como aprendi Apache Spark — Parte 5: Joins — Shuffle, Broadcast e estratégias de execução
#
dataengineering
#
bigdata
#
spark
#
cluster
Comments
Add Comment
14 min read
Moderation
## Load balancing for system design interviews, explained
Gowtham Potureddi
Gowtham Potureddi
Gowtham Potureddi
Follow
Oct 24
## Load balancing for system design interviews, explained
#
interview
#
walkin
#
designsystem
#
dataengineering
Comments
Add Comment
14 min read
Moderation
Designing a parking lot: the low-level design interview, explained
Gowtham Potureddi
Gowtham Potureddi
Gowtham Potureddi
Follow
Oct 24
Designing a parking lot: the low-level design interview, explained
#
walkin
#
interview
#
designsystem
#
dataengineering
Comments
Add Comment
15 min read
Moderation
Your salary coverage can fall before employers change
Dataspryva
Dataspryva
Dataspryva
Follow
Oct 24
Your salary coverage can fall before employers change
#
datascience
#
python
#
dataengineering
#
sql
Comments
Add Comment
7 min read
Moderation
Microservices architecture interview questions, answered
Gowtham Potureddi
Gowtham Potureddi
Gowtham Potureddi
Follow
Oct 24
Microservices architecture interview questions, answered
#
interview
#
walkin
#
designsysetm
#
dataengineering
Comments
Add Comment
16 min read
Moderation
Message queues and pub/sub for system design interviews, explained
Gowtham Potureddi
Gowtham Potureddi
Gowtham Potureddi
Follow
Oct 24
Message queues and pub/sub for system design interviews, explained
#
walkin
#
interview
#
designsystem
#
dataengineering
Comments
Add Comment
15 min read
Moderation
Kafka Consumers on EKS: Designing for a Platform That Restarts Your Consumer Group
Charan Reddy Rachumalla
Charan Reddy Rachumalla
Charan Reddy Rachumalla
Follow
Oct 28
Kafka Consumers on EKS: Designing for a Platform That Restarts Your Consumer Group
#
kafka
#
dataengineering
#
kubernetes
#
streaming
1
 reaction
Comments
1
 comment
9 min read
Moderation
Building a Data Fabric on AWS: Connect Data, Improve Governance, and Power AI
Muhammad Umair Ashraf
Muhammad Umair Ashraf
Muhammad Umair Ashraf
Follow
Oct 24
Building a Data Fabric on AWS: Connect Data, Improve Governance, and Power AI
#
aws
#
dataengineering
#
cloud
#
analytics
Comments
Add Comment
5 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account