Associate Big Data Engineer

Coforge is actively seeking a highly skilled and experienced Big Data Engineer to join our dynamic team. This pivotal role is perfect for professionals with 6 to 10 years of hands-on experience in the big data ecosystem, eager to contribute to innovative projects. As a Big Data Engineer at Coforge, you will be instrumental in designing, developing, and maintaining scalable data solutions that drive critical business insights and operational efficiency across various clients.

You will play a crucial role in building robust and high-performance data pipelines, leveraging your expertise in cutting-edge big data technologies. This position demands a proactive problem-solver with a strong technical background and a commitment to delivering high-quality, impactful data solutions. We are looking for early joiners who can quickly integrate and make a significant contribution to our projects.

Key Responsibilities

• Design, develop, and implement scalable and efficient big data solutions and data pipelines using Spark and Scala.
• Manage and optimize large datasets within the Hadoop ecosystem and other distributed systems.
• Utilize AWS cloud services for deploying, managing, and scaling big data applications.
• Write complex SQL queries for data extraction, transformation, and loading (ETL) processes, ensuring data integrity and accuracy.
• Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver robust solutions.
• Monitor, troubleshoot, and optimize big data platforms and applications for performance and reliability.
• Implement best practices for data governance, security, and quality assurance.
• Stay abreast of new big data technologies and methodologies, evaluating their potential application to enhance our data infrastructure.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 6 to 10 years of extensive experience as a Big Data Engineer or in a similar role.
• Proven expertise in Spark and Scala for developing high-performance data processing applications.
• Strong hands-on experience with AWS cloud services (e.g., S3, EMR, Glue, Redshift, Lambda).
• In-depth knowledge and practical experience with the Hadoop ecosystem (HDFS, YARN, Hive, etc.).
• Exceptional proficiency in SQL, with the ability to write complex queries and perform database optimization.
• Experience with data warehousing concepts and ETL/ELT processes.
• Excellent problem-solving skills and the ability to work independently and as part of a team.
• Strong communication and interpersonal skills.

What We Offer

• An opportunity to work on challenging and innovative big data projects with a leading global IT solutions provider.
• A collaborative and supportive work environment that fosters learning and professional growth.
• Exposure to a wide range of industry domains and cutting-edge technologies.
• Competitive compensation and benefits package.
• A chance to significantly impact critical client initiatives as a valued Big Data Engineer.