Data Engineer
Data Engineer (Public Sector)
Xtremax · Singapore, Singapore, Singapore
Technologies on this row: AWS, Azure, Google Cloud, Hadoop, Spark, Kafka, RabbitMQ, Python, SQL, SSIS, AWS DMS, AWS Lambda, Glue, ECS, EventBridge, PostgreSQL, MySQL, MongoDB, Cassandra, SQLite, VoltDB, AWS S3, Athena, Postgres/GIS.
Description
Role Overview
The Data Engineer will design, build, and maintain data pipelines and systems to power products and analytics, working closely with architects, analysts, and developers.
What You Will Do
The Data Engineer will perform data extraction, cleaning, transformation, and flow, including web scraping, and build and maintain large-scale batch and real-time data pipelines.
Why It Might Be a Fit
Candidates with public sector experience are preferred, and the role requires strong proficiency in data cleaning and transformation, as well as experience with ETL pipeline tools and frameworks.
Requirements
- Strong proficiency in data cleaning and transformation (e.g., SQL, pandas, R)
- 2–5 years or more of relevant experience
- Hands-on experience with ETL pipeline tools/frameworks (e.g., SSIS, AWS DMS, AWS Lambda, Glue, ECS, EventBridge, Python, Spring)
- Proficient in database design and experience with multiple databases (e.g., SQL, PostgreSQL, MySQL, MongoDB, Cassandra, SQLite, VoltDB, AWS S3, Athena, Postgres/GIS)
- Familiarity with big data frameworks and tools (e.g., Hadoop, Spark, Kafka, RabbitMQ)
- Solid understanding of system design, data structures, and algorithms
- Comfortable with at least one scripting language (e.g., Python, SQL)
- Experience working in both Windows and Linux environments
Company facts from the job row
- Headcount
- 201-500 employees
- Funding
- Not on the Hirebase row.
- Technologies on roles
- Athena, AWS, AWS DMS, AWS Lambda, AWS S3, Azure, Cassandra, ECS, EventBridge, Glue, Google Cloud, Hadoop, Kafka, MongoDB, MySQL, Postgres/GIS, PostgreSQL, Python, RabbitMQ, Spark, SQL, SQLite, SSIS, VoltDB
