Data Platform Engineer
Senior Data Engineer, Data Platform
Rakuten Viki · Remote
Technologies on this row: Apache Iceberg, Parquet, Spark, Trino, Redshift, BigQuery, Snowflake, Airflow, dbt, Kafka, Kubernetes, Terraform.
Description
Role Overview
The Senior Data Engineer will design and deliver scalable data systems, set the technical bar through design reviews and code reviews, and mentor other engineers on the team. The ideal candidate combines strong software engineering foundations with deep data engineering experience.
What You Will Do
Key responsibilities include designing, building, and owning scalable batch and streaming pipelines, leading the technical design of platform components, contributing to the platform evolution, and upholding engineering excellence through CI/CD for data.
Why It Might Be a Fit
The ideal candidate will have strong software engineering foundations, deep data engineering experience, and the ability to turn ambiguous business needs into well-designed data solutions.
Requirements
- Bachelor's or Master's in Computer Science or a related field, or equivalent experience building software systems or products
- 6+ years of experience developing production-critical software, including 4+ years building data systems
- Strong software engineering foundations: design patterns, refactoring, automated testing, CI/CD and code review
- Hands-on experience in Python and SQL; Scala, Java or Go is a plus
- Very strong SQL, with experience in query optimization and data modeling
- Good hands-on experience in data modeling, such as Kimball dimensional modeling, and applying it to solve business analytics requirements
- Hands-on experience with lakehouse or warehouse technologies such as Apache Iceberg, Parquet, Spark on EMR, Trino, Redshift, BigQuery or Snowflake
- Experience with orchestration and transformation tools, particularly Airflow and dbt
- Experience building streaming jobs (e.g. Kafka connectors) and being able to debug and troubleshoot them
- Experience building and operating data applications on AWS, including infrastructure-as-code (e.g. Terraform)
- Hands-on experience with Kubernetes to run batch and streaming jobs
- Strong communication skills: able to explain technical choices to engineers and their business value to non-technical stakeholders
Company facts from the job row
- Headcount
- 51-200 employees
- Funding
- Convertible note, 2013-01-01
- Technologies on roles
- Airflow, Apache Iceberg, BigQuery, dbt, Kafka, Kubernetes, Parquet, Redshift, Snowflake, Spark, Terraform, Trino
