
Senior / Lead Data Engineer
Kforce Inc
About this job
Kforce Inc. is actively seeking highly skilled and experienced Senior and Lead Data Engineers to join our dynamic team. This is a critical remote opportunity for professionals based out of Pune, offering the chance to work on cutting-edge data platforms and contribute to significant projects. As a Data Engineer at Kforce, you will be instrumental in designing, developing, and maintaining scalable data architectures and pipelines that power crucial business intelligence and analytical capabilities.
We are searching for individuals who possess a strong foundation in modern data engineering principles and are eager to tackle complex challenges. The ideal candidate will thrive in a fast-paced environment and demonstrate a passion for leveraging data to drive insights and innovation. This role offers the unique opportunity to shape our data landscape and collaborate with a talented group of engineers and stakeholders.
Key Responsibilities
- Design, develop, and implement robust, scalable, and efficient data pipelines using Microsoft Azure technologies.
- Architect and optimize data models within a Medallion Architecture framework, ensuring data quality and integrity.
- Utilize Spark and PySpark for advanced data processing, transformation, and analytics on large datasets.
- Manage and optimize data lakes (ADLS) for efficient storage and retrieval of structured and unstructured data.
- Implement data governance strategies using Microsoft Purview and other data cataloging tools.
- Integrate various data sources, including APIs and SaaS platforms, to consolidate data for comprehensive analysis.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
- Mentor junior engineers and contribute to best practices in data engineering and development.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field.
- For Senior Data Engineer: 7-9+ years of professional experience in data engineering roles.
- For Lead Data Engineer: 10-15+ years of experience, with a proven track record as a hands-on technical leader.
- Extensive experience with Microsoft Azure data services, including Azure Synapse, Azure Data Factory (ADF), and ADLS.
- Proficiency in Spark and PySpark for data processing and ETL/ELT operations.
- Strong understanding and practical experience with Medallion Architecture and advanced data modelling techniques.
- Familiarity with data governance tools like Microsoft Purview and Azure Key Vault for security.
- Experience with Power BI for data visualization and reporting is highly desirable.
- Excellent problem-solving skills and the ability to work independently and as part of a team.
What We Offer
- A 100% remote work opportunity for candidates based in Pune.
- Engage in challenging projects that foster continuous learning and professional growth.
- A collaborative and supportive work environment with a focus on innovation.
- The chance to work with cutting-edge data technologies and contribute to significant business outcomes.
- Competitive compensation package aligned with industry standards and experience.
Eligibility
Professionals • 7-15 years of experience