Data Engineer

Senior Data Engineer – Databricks, dbt & GenAI

Kyndryl · Hybrid, Chennai, Tamil Nadu, India; Bangalore, Karnataka, India

Technologies on this row: Databricks, dbt, Python, Delta Lake, Databricks SQL, Unity Catalog, Workflows.

Description

Role Overview Design and build advanced data platforms that power next-generation AI and Generative AI solutions. Leverage expertise in Databricks, dbt, Python, and modern data architectures to create scalable, intelligent, and high-performing data ecosystems. What You Will Do Design and build scalable data pipelines, develop and optimize Retrieval-Augmented Generation (RAG) frameworks, create and maintain vectorized data processing pipelines, build semantic data layers, and develop and manage dbt models. Why It Might Be a Fit Collaborate with AI Engineers, Data Scientists, Architects, and Business Stakeholders to translate business requirements into scalable technical solutions. Drive engineering best practices in data modeling, version control, testing, documentation, security, and cloud-native development. Requirements - 7+ years of hands-on experience in Data Engineering - Expert-level proficiency in dbt Core - Strong hands-on experience with the Databricks Lakehouse Platform - Advanced proficiency in SQL - Strong experience designing and implementing dimensional models - Proficiency in Python for data engineering - Experience developing and supporting data ingestion pipelines - Strong understanding of Generative AI concepts - Experience preparing, governing, and optimizing enterprise data for AI, machine learning, and GenAI use cases - Hands-on experience implementing and enforcing enterprise data governance, security, lineage, and quality frameworks - Experience establishing and supporting CI/CD pipelines for data platforms - Strong troubleshooting, performance tuning, monitoring, and operational support experience within cloud-based data platforms

Company facts from the job row

Headcount
10,001+ employees
Funding
Post IPO debt, 2024-02-20
Technologies on roles
Apache Spark, Azure Analytics, Azure Blob Storage, Azure Data Factory, Azure Data Lake Storage, Azure Databricks, Azure DevOps, Azure Event Hubs, Azure Functions, Azure SQL Database, Azure Storage Accounts, Azure Synapse Analytics, Databricks, Databricks SQL, dbt, Delta Lake, FastAPI, Git, Git repositories, Google BigQuery, Medallion Architecture, PySpark, pytest, Python, REST APIs, SQL, SQL Server, T-SQL, Unity Catalog, Workflows

Related reading

Browse jobs