Data Engineer
Data Engineer - Python
Softtek · Mexico
Technologies on this row: Azure, Python, SQL, Pandas, DuckDB, Parquet/CSV, FastAPI, REST APIs, Docker, Terraform, Azure DevOps.
Description
Role Overview
The Data Engineer will design and develop data ingestion processes, build backend services, and implement data quality engines. The role requires experience in data engineering, Azure, and Python. The engineer will work in an agile environment and participate in high-volume testing.
What You Will Do
Design and develop data ingestion processes, build backend services, implement data quality engines, automate infrastructure in Azure, and ensure security, scalability, and performance of the implemented solutions.
Why It Might Be a Fit
The ideal candidate will have more than 4 years of experience in data engineering, at least 2 years working with Microsoft Azure, and advanced development in Python for data processing and backend services.
Requirements
- More than 4 years of experience in Data Engineering
- At least 2 years working with Microsoft Azure
- Advanced development in Python for data processing and backend services
- SQL, Pandas, DuckDB, and Parquet/CSV formats mastery
- Experience with Azure Data Lake Storage Gen2, Blob Storage, and Cosmos DB
- Knowledge of FastAPI, REST APIs, and asynchronous processing
- Experience with Docker, Terraform, and Azure DevOps
- Implementation of good security practices in Azure (Entra ID, Managed Identities, Key Vault)
- Experience processing large volumes of data in productive environments
- Automated testing and software development standards management
Company facts from the job row
- Headcount
- 10,001+ employees
- Funding
- Not on the Hirebase row.
- Technologies on roles
- Azure, Azure DevOps, Docker, DuckDB, FastAPI, Pandas, Parquet/CSV, Python, REST APIs, SQL, Terraform
