Associate Big Data Engineer

CGI is actively seeking a highly skilled and experienced Azure Databricks Data Engineer to join our dynamic team in Pune. This is an exceptional opportunity for a seasoned professional to contribute to cutting-edge data initiatives, designing, developing, and maintaining robust data solutions that power critical business decisions. If you are passionate about transforming complex data into actionable insights and thrive in a collaborative environment, we encourage you to explore this challenging and rewarding role.

Key Responsibilities

• Design, develop, and implement scalable data pipelines using Azure Databricks and other Azure data services.
• Extract, transform, and load (ETL) data from various sources into data warehouses and data lakes.
• Optimize data processing workflows for performance, reliability, and cost-efficiency.
• Collaborate with data scientists, analysts, and other engineers to understand data requirements and deliver appropriate solutions.
• Ensure data quality, integrity, and security across all data platforms.
• Monitor, troubleshoot, and resolve issues related to data pipelines and data infrastructure.
• Participate in code reviews, contribute to architectural discussions, and promote best practices in data engineering.
• Develop and maintain comprehensive documentation for data processes and architectures.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Minimum of 4 years of professional experience as a Data Engineer, with a strong focus on Microsoft Azure.
• Proven expertise in developing and optimizing solutions using Azure Databricks.
• Proficiency in programming languages such as Python or Scala, and strong SQL skills.
• Solid understanding of data warehousing concepts, data modeling, and ETL processes.
• Experience with other Azure data services like Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory.
• Familiarity with big data technologies and distributed computing frameworks (e.g., Apache Spark).
• Excellent problem-solving abilities and a keen eye for detail.
• Strong communication and interpersonal skills, with the ability to work effectively in a team.
• Candidates available for immediate joining will be given preference.

What We Offer

• An exciting opportunity to work on impactful projects with cutting-edge Azure technologies.
• A collaborative and supportive work environment that fosters innovation and continuous learning.
• Competitive compensation package and comprehensive benefits.
• Opportunities for professional growth and career advancement within a global organization.
• A chance to be part of a team that is passionate about leveraging data to drive business success.