AI Data Engineer

Innovatix Inc. is actively seeking a highly skilled and experienced Data Engineer to join our fully remote team. This is an exceptional opportunity for a professional with over 5 years of experience to contribute significantly to our data infrastructure. As a Data Engineer, you will play a critical role in designing, developing, and maintaining scalable data pipelines, ensuring data quality, and optimizing our data systems to support business insights and operational efficiency.

We are looking for someone who thrives in an independent working environment and possesses strong technical expertise in database management, scripting, and cloud services. If you are passionate about data, meticulous about quality, and adept at building robust data solutions, we encourage you to apply and help us shape the future of our data architecture.

Key Responsibilities

• Design, develop, and maintain robust and scalable data pipelines using Apache Airflow for scheduling and managing complex DAGs.
• Perform advanced data modeling, query optimization, indexing, and execution plan analysis within PostgreSQL databases to ensure high performance.
• Develop and implement strong complex SQL queries, utilizing CTEs, window functions, and advanced joins for data extraction and transformation.
• Write clean, efficient Python scripts for automating data extraction, transformation, and operational tasks across various systems.
• Establish and maintain data quality standards, including validation, reconciliation, completeness/freshness checks, and anomaly detection.
• Integrate data from diverse sources using REST APIs, managing authentication, pagination, incremental extraction, and schema changes.
• Deploy, configure, and debug data services and jobs on AWS, leveraging various cloud offerings.
• Implement and enforce Git workflows, pull requests, and CI/CD pipelines to ensure code quality and efficient deployment.
• Troubleshoot and resolve data-related issues, ensuring data integrity and system reliability.
• Collaborate effectively with cross-functional teams in a distributed environment, providing technical expertise and data-driven insights.

Requirements

• Minimum of 5 years of professional experience in a Data Engineer role or similar capacity.
• Advanced proficiency in PostgreSQL, including data modeling, query optimization, and performance tuning.
• Extensive hands-on experience with Apache Airflow for production DAG development, scheduling, and troubleshooting.
• Strong expertise in SQL, capable of writing complex queries with CTEs, window functions, and performance optimizations.
• Demonstrated strong Python scripting skills for data manipulation, automation, and operational support.
• Solid understanding and practical experience with data quality principles, validation, and troubleshooting methodologies.
• Proven experience working with Jira, including knowledge of its data model and REST API for integrations.
• Expertise in integrating and managing data from REST APIs, handling authentication and data extraction challenges.
• Hands-on experience deploying, configuring, and debugging data services and jobs within the AWS ecosystem.
• Familiarity with Git workflows, pull requests, and CI/CD practices.
• Excellent written communication skills and the ability to work independently as part of a remote, distributed team.

What We Offer

• The opportunity to work remotely, offering flexibility and work-life balance.
• Engage in challenging and impactful projects that contribute directly to the company’s success.
• A collaborative and supportive team environment focused on innovation and problem-solving.
• Continuous learning and professional development opportunities in a rapidly evolving tech landscape.
• Be part of a forward-thinking company that values data-driven decision-making.