Data Platform Engineer
Lead Data Engineer – Azure Data Platform
Kyndryl · Hybrid, Chennai, Tamil Nadu, India; Bangalore, Karnataka, India
Technologies on this row: Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, Databricks, T-SQL, Git repositories, Azure DevOps.
Description
Role Overview
As a Lead Data Engineer, you will design, build, and optimize scalable data solutions that enable organizations to transform data into valuable business insights. You will leverage your expertise in Azure data services, modern data architectures, data integration, and automation to deliver secure, reliable, and high-performing data platforms.
What You Will Do
Design, develop, and maintain scalable data pipelines using Azure data services to ingest, process, and transform data from multiple sources. Build and optimize data integration solutions using Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, Databricks, and related technologies.
Why It Might Be a Fit
You will collaborate closely with AI specialists, data scientists, architects, software engineers, and business leaders to solve complex challenges through advanced data and AI solutions.
Requirements
- 7+ years of hands-on experience in Data Engineering, Data Warehousing, Database Engineering, or Data Platform Development
- Strong experience designing, developing, and maintaining enterprise data solutions using Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, SQL Server, Databricks, and Google BigQuery
- Proven expertise in database engineering, data architecture, and data modeling, including conceptual, logical, and physical data model design
- Experience building and managing scalable data pipelines, data warehouses, and cloud-based data platforms
- Strong proficiency in T-SQL, including views, stored procedures, functions, query optimization, and performance tuning
- Experience creating and managing Azure Data Factory pipelines for batch and real-time data integration processes
- Strong understanding of ETL/ELT frameworks, data migration strategies, data conversion processes, and data lifecycle management
- Experience with Azure Data Lake structure, security, governance, and access management
- Hands-on experience developing automated reporting, data integration, and data processing solutions
- Strong knowledge of data warehouse methodologies, dimensional modeling, star schema, fact and dimension tables, and Master Data Management (MDM)
- Experience working with application development lifecycles, including architecture, development, testing, deployment, and production support
- Experience implementing CI/CD best practices, Agile methodologies, version control, refactoring, and automated testing frameworks
- Experience performing unit testing, integration testing, performance testing, load testing, and troubleshooting complex data processing issues
- Knowledge of Git repositories, branching strategies, Azure DevOps, release management, and deployment automation practices
Benefits
- Flexible, supportive environment
- Well-being prioritized
- Potential to thrive and contribute to the culture of empathy and shared success
- Be Well programs to support financial, mental, physical, and social health
- Dynamic, hybrid-friendly culture
- Powerful tools to chart career path and personalized development goals aligned with ambitions
- Continuous feedback to keep inspired and on track
- Cutting-edge learning opportunities, including certifications with Microsoft, Google, and Amazon
- Access to coaching and hands-on experiences
Company facts from the job row
- Headcount
- 10,001+ employees
- Funding
- Post IPO debt, 2024-02-20
- Technologies on roles
- Azure Data Factory, Azure Data Lake Storage, Azure DevOps, Azure Functions, Azure SQL Database, Azure Storage Accounts, Azure Synapse Analytics, Databricks, Databricks SQL, dbt, Delta Lake, Git repositories, Google BigQuery, Python, SQL, SQL Server, T-SQL, Unity Catalog, Workflows
