Lead Azure Data Engineer

Location: Hyderabad

Duration: Fulltime

Openings: 1

Job Type: Hybrid

Job Description:

We are seeking a highly skilled and experienced Azure Data Engineering Lead to join our dynamic team. As an Azure Data Engineering Lead, you will be responsible for designing, building, and maintaining scalable data solutions on the Azure platform.

Responsibilities:

• Develop and maintain data pipelines using Azure Data Factory (ADF) for data ingestion, transformation, and loading.
• Implement data processing workflows & Delta Lakehouses using Azure Databricks (ADB), DataBricks SQL, SQL and PySpark for large-scale data processing and analysis.
• Write complex SQL queries and scripts for data manipulation and transformation.
• Collaborate with data architects and business analysts to understand data requirements and translate them into technical solutions.
• Optimize data pipelines for performance, scalability, and reliability.
• Implement data security and privacy measures to ensure compliance with industry standards and regulations.
• Monitor and troubleshoot data pipelines to ensure data integrity and availability.
• Stay abreast of Azure data engineering tools and technologies to enhance data solutions.
• Mentor, lead & assign tasks to the junior team members in the team and provide technical guidance and support.

Experience:

• Overall 8+ years of IT Experience & minimum 6 years in building data solutions on the Azure platform.
• Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks (ADB), SQL, PySpark, and other Azure data tools.
• Solid understanding of data engineering principles, data modelling, ETL processes and best practices.
• Strong problem-solving and analytical skills. Excellent Communication & Leadership skills.
• Experience working with large-scale, distributed data systems and architectures.
• Ability to work independently & work effectively in a collaborative team environment.
• Eagerness to learn and adapt to new technologies and methodologies.
• Azure certification (e.g., Azure Data Engineer Associate) or Data Bricks certification is a plus.

Note: This job description is intended to convey information essential to understanding the scope of the position and is not an exhaustive list of skills, efforts, duties, responsibilities, or working conditions associated with it. Responsibilities may change based on organizational need.