AI Data Engineer

Digital Dhara is actively seeking a highly skilled and experienced GCP Data Engineer to join our dynamic team on a contract basis. This is an excellent opportunity for a data professional with strong hands-on experience in Google Cloud data technologies, particularly Lumi, BigQuery, Dataflow, Dataproc, and GCS. The role is based onsite in Phoenix, AZ, and requires an individual with a deep understanding of developing robust ETL/ELT pipelines and implementing sophisticated data integration and transformation solutions within a cloud environment. As a GCP Data Engineer, you will play a crucial role in designing, building, and maintaining our next-generation data infrastructure, ensuring optimal data delivery architecture is consistent throughout ongoing projects. If you're passionate about leveraging Google Cloud Platform to build scalable, high-performance data solutions and thrive in a challenging environment, we encourage you to apply.

Key Responsibilities

• Design, develop, and maintain high-performance, scalable ETL/ELT pipelines and data processing systems using Google Cloud Platform services.
• Utilize core GCP data technologies such as BigQuery for data warehousing and analytics, Dataflow for batch and stream processing, Dataproc for big data processing, and Google Cloud Storage (GCS) for data lakes and storage solutions.
• Implement complex data integration and transformation strategies to cleanse, normalize, and enrich data, ensuring data quality, accuracy, and accessibility for various business needs.
• Develop and optimize robust data solutions using Python and SQL, including scripting, stored procedures, and complex queries, to manage and manipulate large, diverse datasets effectively.
• Orchestrate data workflows and automate processes using Cloud Composer for scheduling and managing data pipelines, and integrate with Pub/Sub for real-time, event-driven architectures and data streaming.
• Collaborate closely with data scientists, analysts, and other engineering teams to understand data requirements, define data models, and deliver robust, scalable data engineering solutions that support analytical and operational objectives.
• Monitor, troubleshoot, and optimize data pipeline performance, security, and cost-efficiency to ensure the reliability, efficiency, and scalability of data operations across the GCP ecosystem.
• Stay abreast of the latest GCP features and data engineering best practices to continuously improve our data platform and processes.

Requirements

• Proven experience as a GCP Data Engineer with a strong portfolio of successful data projects on Google Cloud, demonstrating expertise in developing and deploying production-grade data solutions.
• Extensive hands-on experience with key GCP data services including BigQuery, Dataflow, Dataproc, and GCS, along with a deep understanding of their capabilities and best use cases.
• Proficiency in Python and SQL for data manipulation, scripting, and advanced database querying, with a focus on writing efficient and optimized code.
• Solid experience in designing, implementing, and optimizing complex ETL/ELT pipelines and data warehousing solutions from source to destination.
• Familiarity with workflow orchestration tools like Cloud Composer and messaging services such as Pub/Sub for building resilient and automated data flows.
• Strong understanding of data modeling principles, data governance, metadata management, and best practices for data management in a cloud-native environment.
• Experience with version control systems (e.g., Git) and agile development methodologies.
• Excellent problem-solving skills, analytical thinking, and the ability to work independently and as part of a collaborative team in a fast-paced setting.
• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related technical field, or equivalent practical experience.

What We Offer

• A challenging contract opportunity to work on cutting-edge Google Cloud Platform data projects, contributing to significant data initiatives.
• Exposure to a collaborative and innovative work environment at Digital Dhara, where your contributions are valued and make a real impact.
• Competitive compensation package for your expertise and dedication, reflecting your value to our projects.
• Opportunity to continuously enhance your skills and expand your professional network within the rapidly evolving data engineering domain and Google Cloud ecosystem.
• Be part of a forward-thinking team committed to leveraging the latest technologies to solve complex data challenges.