RiseFlake

AWS Data Engineer - Databricks

AWS Data Engineer - Databricks

IBM

IBM
  • 6 yrs
  • Not disclosed
  • Chennai, Tamil Nadu

Full-time · On Field

1 opening

Applications for this job are closed

This listing is no longer accepting applications, but we're keeping it up for reference.

Job description

We are actively seeking an experienced and highly skilled AWS Data Engineer to join our dynamic team. This pivotal role requires strong hands-on expertise in designing, building, and managing robust, scalable data pipelines within the Amazon Web Services (AWS) ecosystem. The ideal candidate will be proficient in leveraging various AWS data services, possess excellent PySpark capabilities, and demonstrate superior SQL skills to drive efficient data solutions. As an AWS Data Engineer, you will play a crucial role in transforming raw data into actionable insights, supporting critical business functions and data-driven decision-making.

Key Responsibilities

  • Design, develop, and maintain highly scalable and reliable data pipelines using a range of AWS services.
  • Implement and optimize ETL/ELT processes to ingest, transform, and load large datasets into data lakes and data warehouses.
  • Develop robust data processing applications and solutions using PySpark for complex data transformations and analytics.
  • Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver comprehensive data solutions.
  • Ensure data quality, integrity, and security across all data pipelines and storage solutions within the AWS environment.
  • Monitor pipeline performance, troubleshoot issues, and implement proactive measures to ensure operational efficiency and reliability.
  • Contribute to the continuous improvement of data engineering practices, tools, and infrastructure.

Requirements

  • Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field.
  • Minimum of 6+ years of professional experience in data engineering, with a strong focus on AWS cloud platforms.
  • Demonstrated hands-on expertise with AWS data services, including AWS Lambda, AWS Step Functions, AWS Glue, and S3.
  • Exceptional proficiency in PySpark for large-scale data processing and analytics.
  • Advanced SQL skills for data querying, manipulation, and database management.
  • Proven experience in designing, building, and optimizing complex data pipelines from various sources.
  • Solid understanding of cloud-based data engineering principles, data warehousing concepts, and ETL methodologies.
  • Ability to work effectively in a fast-paced environment and manage multiple priorities.

What We Offer

  • An opportunity to work on challenging and impactful data engineering projects leveraging cutting-edge AWS technologies.
  • A collaborative and innovative work environment that fosters continuous learning and professional growth.
  • Exposure to a diverse range of industries and data challenges.
  • A culture that values technical excellence and problem-solving.
  • Opportunities for skill enhancement and career advancement in a rapidly evolving field.

Job details

Role
AWS Data Engineer - Databricks
Category
Data Engineer, Information Technology (IT), Software Development
Employment type
Full-time
Work mode
On Field
Experience
6 yrs
Salary
Not disclosed
Location
Chennai, Tamil Nadu
Openings
1
Who can apply
Professionals • 6-6 years of experience

Key skills

  • AWS
  • AWS Glue
  • AWS Lambda
  • SQL

Perks and benefits

  • Certificate / Experience Letter
  • Laptop / Equipment Provided
  • Stipend / Salary
  • Training and Mentorship

About the company

Similar jobs hiring now

  • 7-10 yrs
  • Not disclosed
  • Remote

Business Analyst · HR Manager · Operations Manager · Microsoft Office Proficiency

Full-time
  • 11 yrs
  • Not disclosed
  • Remote

Engineering · Full Stack Developer · Software Development · Angular · Docker · Git

Full-time

HR Manager

Priyagold

  • 8-12 yrs
  • Not disclosed
  • Dahegam

HR Manager · Employee Engagement · Payroll Management · Performance Management · Recruitment Marketing

Full-time · In Office

AWS Data Engineer

Avance Consulting

  • 10 yrs
  • Not disclosed
  • Remote

Cloud Architect · Data Engineer · Information Technology (IT) · AWS · Databricks · Python

Full-time

BIPPL has taken all reasonable steps to ensure that information on this site is authentic. Applicants are advised to research bonafides of advertisers independently. BIPPL shall not have any responsibility in this regard. We also recommend that you visit Security Guidelines and Terms of Service for more comprehensive information on this aspect. Please note that RiseFlake will not be responsible for any information you share on the company platform.