Data Engineer
Senior Data Engineer – Databricks, dbt & GenAI
Kyndryl · Hybrid, Chennai, Tamil Nadu, India; Bangalore, Karnataka, India
Technologies on this row: Databricks, dbt, Python, Delta Lake, Databricks SQL, Unity Catalog, Workflows.
Description
Role Overview
Design and build advanced data platforms that power next-generation AI and Generative AI solutions. Leverage expertise in Databricks, dbt, Python, and modern data architectures to create scalable, intelligent, and high-performing data ecosystems.
What You Will Do
Design and build scalable data pipelines, develop and optimize Retrieval-Augmented Generation (RAG) frameworks, create and maintain vectorized data processing pipelines, build semantic data layers, and develop and manage dbt models.
Why It Might Be a Fit
Collaborate with AI Engineers, Data Scientists, Architects, and Business Stakeholders to translate business requirements into scalable technical solutions. Drive engineering best practices in data modeling, version control, testing, documentation, security, and cloud-native development.
Requirements
- 7+ years of hands-on experience in Data Engineering
- Expert-level proficiency in dbt Core
- Strong hands-on experience with the Databricks Lakehouse Platform
- Advanced proficiency in SQL
- Strong experience designing and implementing dimensional models
- Proficiency in Python for data engineering
- Experience developing and supporting data ingestion pipelines
- Strong understanding of Generative AI concepts
- Experience preparing, governing, and optimizing enterprise data for AI, machine learning, and GenAI use cases
- Hands-on experience implementing and enforcing enterprise data governance, security, lineage, and quality frameworks
- Experience establishing and supporting CI/CD pipelines for data platforms
- Strong troubleshooting, performance tuning, monitoring, and operational support experience within cloud-based data platforms
Company facts from the job row
- Headcount
- 10,001+ employees
- Funding
- Post IPO debt, 2024-02-20
- Technologies on roles
- Apache Spark, Azure Analytics, Azure Blob Storage, Azure Data Factory, Azure Data Lake Storage, Azure Databricks, Azure DevOps, Azure Event Hubs, Azure Functions, Azure SQL Database, Azure Storage Accounts, Azure Synapse Analytics, Databricks, Databricks SQL, dbt, Delta Lake, FastAPI, Git, Git repositories, Google BigQuery, Medallion Architecture, PySpark, pytest, Python, REST APIs, SQL, SQL Server, T-SQL, Unity Catalog, Workflows
