Data Engineer

Data Engineer (Public Sector)

Xtremax · Singapore, Singapore, Singapore

Technologies on this row: AWS, Azure, Google Cloud, Hadoop, Spark, Kafka, RabbitMQ, Python, SQL, SSIS, AWS DMS, AWS Lambda, Glue, ECS, EventBridge, PostgreSQL, MySQL, MongoDB, Cassandra, SQLite, VoltDB, AWS S3, Athena, Postgres/GIS.

Description

Role Overview The Data Engineer will design, build, and maintain data pipelines and systems to power products and analytics, working closely with architects, analysts, and developers. What You Will Do The Data Engineer will perform data extraction, cleaning, transformation, and flow, including web scraping, and build and maintain large-scale batch and real-time data pipelines. Why It Might Be a Fit Candidates with public sector experience are preferred, and the role requires strong proficiency in data cleaning and transformation, as well as experience with ETL pipeline tools and frameworks. Requirements - Strong proficiency in data cleaning and transformation (e.g., SQL, pandas, R) - 2–5 years or more of relevant experience - Hands-on experience with ETL pipeline tools/frameworks (e.g., SSIS, AWS DMS, AWS Lambda, Glue, ECS, EventBridge, Python, Spring) - Proficient in database design and experience with multiple databases (e.g., SQL, PostgreSQL, MySQL, MongoDB, Cassandra, SQLite, VoltDB, AWS S3, Athena, Postgres/GIS) - Familiarity with big data frameworks and tools (e.g., Hadoop, Spark, Kafka, RabbitMQ) - Solid understanding of system design, data structures, and algorithms - Comfortable with at least one scripting language (e.g., Python, SQL) - Experience working in both Windows and Linux environments

Company facts from the job row

Headcount
201-500 employees
Funding
Not on the Hirebase row.
Technologies on roles
Athena, AWS, AWS DMS, AWS Lambda, AWS S3, Azure, Cassandra, ECS, EventBridge, Glue, Google Cloud, Hadoop, Kafka, MongoDB, MySQL, Postgres/GIS, PostgreSQL, Python, RabbitMQ, Spark, SQL, SQLite, SSIS, VoltDB

Related reading

Browse jobs