Data Engineer

Data Engineer - Python

Softtek · Mexico

Technologies on this row: Azure, Python, SQL, Pandas, DuckDB, Parquet/CSV, FastAPI, REST APIs, Docker, Terraform, Azure DevOps.

Description

Role Overview The Data Engineer will design and develop data ingestion processes, build backend services, and implement data quality engines. The role requires experience in data engineering, Azure, and Python. The engineer will work in an agile environment and participate in high-volume testing. What You Will Do Design and develop data ingestion processes, build backend services, implement data quality engines, automate infrastructure in Azure, and ensure security, scalability, and performance of the implemented solutions. Why It Might Be a Fit The ideal candidate will have more than 4 years of experience in data engineering, at least 2 years working with Microsoft Azure, and advanced development in Python for data processing and backend services. Requirements - More than 4 years of experience in Data Engineering - At least 2 years working with Microsoft Azure - Advanced development in Python for data processing and backend services - SQL, Pandas, DuckDB, and Parquet/CSV formats mastery - Experience with Azure Data Lake Storage Gen2, Blob Storage, and Cosmos DB - Knowledge of FastAPI, REST APIs, and asynchronous processing - Experience with Docker, Terraform, and Azure DevOps - Implementation of good security practices in Azure (Entra ID, Managed Identities, Key Vault) - Experience processing large volumes of data in productive environments - Automated testing and software development standards management

Company facts from the job row

Headcount
10,001+ employees
Funding
Not on the Hirebase row.
Technologies on roles
Azure, Azure DevOps, Docker, DuckDB, FastAPI, Pandas, Parquet/CSV, Python, REST APIs, SQL, Terraform

Related reading

Browse jobs