Hi, I’m Jaehyuk.
I build and operate data platforms at a fintech company in India. I mostly work with Spark, Flink, Debezium, Airflow, and Iceberg. These days I’m interested in modernizing data stacks and building data platforms that are AI-ready.
This is where I write about things I learn along the way.
Tech Stack
- Processing: Spark, Flink, dbt
- Streaming & CDC: Debezium, Kafka, Kinesis, NiFi
- Storage & DW: S3, Athena, Iceberg, DynamoDB
- Orchestration: Airflow
- DevOps & Infra: Docker, Jenkins, SAM, CloudFormation, Lake Formation
- Monitoring: Prometheus, Grafana, CloudWatch, Kibana
- Cloud: AWS
- Languages: Python, SQL
Writing
- How CDC Changes Data Platforms: CDC-based Incremental Replication
- Why We Redesigned Our CDC Pipeline with Debezium and Flink
- From NiFi to Apache Flink: Improving a Real-time SMS Pipeline