Data Platform Engineer

Senior Data Engineer, Data Platform

Rakuten Viki · Remote

Technologies on this row: Apache Iceberg, Parquet, Spark, Trino, Redshift, BigQuery, Snowflake, Airflow, dbt, Kafka, Kubernetes, Terraform.

Description

Role Overview The Senior Data Engineer will design and deliver scalable data systems, set the technical bar through design reviews and code reviews, and mentor other engineers on the team. The ideal candidate combines strong software engineering foundations with deep data engineering experience. What You Will Do Key responsibilities include designing, building, and owning scalable batch and streaming pipelines, leading the technical design of platform components, contributing to the platform evolution, and upholding engineering excellence through CI/CD for data. Why It Might Be a Fit The ideal candidate will have strong software engineering foundations, deep data engineering experience, and the ability to turn ambiguous business needs into well-designed data solutions. Requirements - Bachelor's or Master's in Computer Science or a related field, or equivalent experience building software systems or products - 6+ years of experience developing production-critical software, including 4+ years building data systems - Strong software engineering foundations: design patterns, refactoring, automated testing, CI/CD and code review - Hands-on experience in Python and SQL; Scala, Java or Go is a plus - Very strong SQL, with experience in query optimization and data modeling - Good hands-on experience in data modeling, such as Kimball dimensional modeling, and applying it to solve business analytics requirements - Hands-on experience with lakehouse or warehouse technologies such as Apache Iceberg, Parquet, Spark on EMR, Trino, Redshift, BigQuery or Snowflake - Experience with orchestration and transformation tools, particularly Airflow and dbt - Experience building streaming jobs (e.g. Kafka connectors) and being able to debug and troubleshoot them - Experience building and operating data applications on AWS, including infrastructure-as-code (e.g. Terraform) - Hands-on experience with Kubernetes to run batch and streaming jobs - Strong communication skills: able to explain technical choices to engineers and their business value to non-technical stakeholders

Company facts from the job row

Headcount
51-200 employees
Funding
Convertible note, 2013-01-01
Technologies on roles
Airflow, Apache Iceberg, BigQuery, dbt, Kafka, Kubernetes, Parquet, Redshift, Snowflake, Spark, Terraform, Trino

Related reading

Browse jobs