RiseFlake

AWS Data Engineer - Databricks

AWS Data Engineer - Databricks

IBM

IBM
  • 6 yrs
  • Not disclosed
  • Chennai, Tamil Nadu

Full-time · On Field

1 opening

Applications for this job are closed

This listing is no longer accepting applications, but we're keeping it up for reference.

Job description

Are you an experienced AWS Data Engineer passionate about building robust and scalable data solutions? Join our dynamic team at IBM, where we are at the forefront of leveraging cutting-edge cloud technologies to transform data into actionable insights. We are seeking a highly skilled and motivated AWS Data Engineer with a strong background in PySpark and SQL to design, develop, and optimize our next-generation data platforms.

This pivotal role offers an exciting opportunity to work on complex data challenges, contributing to critical projects that drive business intelligence and innovation. If you thrive in a collaborative environment and possess a deep understanding of cloud-based data engineering, we invite you to be a part of our journey as an AWS Data Engineer.

Key Responsibilities

  • Design, develop, and maintain highly scalable and reliable data pipelines using core AWS services, ensuring data integrity and performance.
  • Implement and optimize ETL processes for extracting, transforming, and loading data from various sources into data lakes and warehouses.
  • Utilize PySpark for advanced data processing, transformation, and analytics on large datasets within the AWS ecosystem.
  • Develop and manage data solutions using AWS Lambda, AWS Step Functions, AWS Glue, and AWS S3 to support diverse business requirements.
  • Collaborate closely with data scientists, analysts, and other engineering teams to understand data needs and deliver effective data solutions.
  • Ensure the quality, security, and governance of data throughout its lifecycle, adhering to best practices and industry standards.
  • Monitor and troubleshoot data pipeline performance, proactively identifying and resolving issues to ensure continuous data flow.
  • Contribute to the continuous improvement of data engineering processes, tools, and methodologies within the IBM framework.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
  • A minimum of 6 years of professional experience in data engineering, with a strong focus on AWS cloud environments.
  • Demonstrable expertise in various AWS services including AWS Lambda, AWS Step Functions, AWS Glue, and AWS S3.
  • Proven hands-on experience with PySpark for big data processing and strong proficiency in Python.
  • Exceptional SQL skills for data querying, manipulation, and optimization of relational databases.
  • Solid understanding of data warehousing concepts, ETL methodologies, and data modeling techniques.
  • Familiarity with data governance, security, and compliance best practices in a cloud environment.
  • Ability to join with immediate or a short notice period is highly preferred.

What We Offer

  • An engaging and challenging work environment at a global technology leader, IBM.
  • Opportunities for professional growth and continuous learning in cutting-edge cloud and data technologies.
  • Work on impactful projects that leverage your skills to solve real-world business problems.
  • A collaborative culture that encourages innovation, teamwork, and knowledge sharing.
  • Competitive compensation package and comprehensive benefits.

Job details

Role
AWS Data Engineer - Databricks
Category
Data Engineer, Information Technology (IT), Software Development
Employment type
Full-time
Work mode
On Field
Experience
6 yrs
Salary
Not disclosed
Location
Chennai, Tamil Nadu
Openings
1
Who can apply
Professionals • 6-6 years of experience

Key skills

  • AWS
  • AWS Glue
  • AWS Lambda
  • Python
  • SQL

Perks and benefits

  • Certificate / Experience Letter
  • Laptop / Equipment Provided
  • Stipend / Salary
  • Training and Mentorship

About the company

Similar jobs hiring now

  • 7-10 yrs
  • Not disclosed
  • Remote

Business Analyst · HR Manager · Operations Manager · Microsoft Office Proficiency

Full-time
  • 11 yrs
  • Not disclosed
  • Remote

Engineering · Full Stack Developer · Software Development · Angular · Docker · Git

Full-time

HR Manager

Priyagold

  • 8-12 yrs
  • Not disclosed
  • Dahegam

HR Manager · Employee Engagement · Payroll Management · Performance Management · Recruitment Marketing

Full-time · In Office

AWS Data Engineer

Avance Consulting

  • 10 yrs
  • Not disclosed
  • Remote

Cloud Architect · Data Engineer · Information Technology (IT) · AWS · Databricks · Python

Full-time

BIPPL has taken all reasonable steps to ensure that information on this site is authentic. Applicants are advised to research bonafides of advertisers independently. BIPPL shall not have any responsibility in this regard. We also recommend that you visit Security Guidelines and Terms of Service for more comprehensive information on this aspect. Please note that RiseFlake will not be responsible for any information you share on the company platform.