Backpressuredhttps://backpressured.dev/en/Recent content on BackpressuredHugoenThu, 11 Jun 2026 00:00:00 +0000The Hidden Cost of CDC Pipelines: How Small Files Create an S3 Request Bombhttps://backpressured.dev/en/posts/cdc-small-file-hidden-cost/Thu, 11 Jun 2026 00:00:00 +0000https://backpressured.dev/en/posts/cdc-small-file-hidden-cost/Athena cost isn&#39;t just about data scanned. Learn how millions of small files from CDC pipelines silently drain your S3 request budget and degrade query performance — and how we fixed it.Abouthttps://backpressured.dev/en/about/Mon, 01 Jan 0001 00:00:00 +0000https://backpressured.dev/en/about/<p>Hi, I&rsquo;m Jaehyuk.</p> <p>I build and operate data platforms at a fintech company in India. I mostly work with Spark, Flink, Debezium, Airflow, and Iceberg. These days I&rsquo;m interested in modernizing data stacks and building data platforms that are AI-ready.</p> <p>This is where I write about things I learn along the way.</p> <h2 id="tech-stack">Tech Stack</h2> <ul> <li><strong>Processing:</strong> Spark, Flink, dbt</li> <li><strong>Streaming &amp; CDC:</strong> Debezium, Kafka, Kinesis, NiFi</li> <li><strong>Storage &amp; DW:</strong> S3, Athena, Iceberg, DynamoDB</li> <li><strong>Orchestration:</strong> Airflow</li> <li><strong>DevOps &amp; Infra:</strong> Docker, Jenkins, SAM, CloudFormation, Lake Formation</li> <li><strong>Monitoring:</strong> Prometheus, Grafana, CloudWatch, Kibana</li> <li><strong>Cloud:</strong> AWS</li> <li><strong>Languages:</strong> Python, SQL</li> </ul> <h2 id="writing">Writing</h2> <ul> <li><a href="https://blog.afinit.com/cdc-incremental-replication">How CDC Changes Data Platforms: CDC-based Incremental Replication</a></li> <li><a href="https://blog.afinit.com/cdc-pipeline-debezium-flink">Why We Redesigned Our CDC Pipeline with Debezium and Flink</a></li> <li><a href="https://blog.afinit.com/nifi-apache-flink-sms-pipeline">From NiFi to Apache Flink: Improving a Real-time SMS Pipeline</a></li> </ul> <h2 id="contact">Contact</h2> <ul> <li><a href="https://linkedin.com/in/jaehyuk-jang-bab185178">LinkedIn</a></li> <li><a href="https://github.com/jaehyukjang">GitHub</a></li> <li>Email: <a href="mailto:jjhyuk92@gmail.com">jjhyuk92@gmail.com</a></li> </ul>