Big Data Engineering Tech SME - Databricks

Tiger Analytics is actively seeking a visionary and highly experienced Big Data Engineering Tech SME - Databricks to join our expert team in India. This critical role is designed for a seasoned professional with 13-20 years of experience, specializing in pioneering big data solutions, advanced cloud architecture, and cutting-edge Generative AI implementations. As a key technical leader, you will be instrumental in driving the strategy, design, and successful implementation of enterprise-scale data platforms, leveraging technologies like Databricks, Azure, GCP, and AWS to deliver unparalleled value and transformative outcomes for our diverse clientele.

As a Big Data Engineering Tech SME - Databricks, you will lead complex data initiatives, influencing architectural decisions and ensuring the robust performance and scalability of our data ecosystems. This is a unique opportunity to shape the future of data engineering and AI within a dynamic consulting environment.

Key Responsibilities

• Lead the end-to-end architecture, design, and implementation of sophisticated Big Data Engineering solutions, with a particular emphasis on Databricks Lakehouse platforms.
• Drive the strategic adoption and seamless integration of Generative AI and Agentic AI solutions, including large language models (LLMs) and Retrieval-Augmented Generation (RAG) architectures, across diverse data pipelines and applications.
• Architect and manage comprehensive enterprise-scale Data Governance frameworks, encompassing metadata management, data quality, data lineage, and advanced data privacy solutions.
• Develop intricate data models (conceptual, logical, physical), formulate robust data architecture strategies, and apply advanced dimensional modelling and Data Vault techniques for complex data ecosystems.
• Provide deep technical expertise and hands-on guidance in cloud data warehousing solutions across major platforms such as Snowflake, Redshift, Synapse, BigQuery, Dataflow, and Dataproc.
• Collaborate proactively with cross-functional teams, spearheading the preparation of RFPs/REIs (Requests for Proposal/Information), and crafting innovative solutions to address complex client data challenges.

Requirements

• 13-20 years of progressive and extensive experience in Big Data Engineering, Data Architecture, or a similar senior technical leadership role.
• Profound expertise in Databricks, including hands-on experience with Lakehouse implementation and Databricks Genie, coupled with strong proficiency across major cloud platforms like Azure, GCP, and AWS.
• Demonstrated experience with Generative AI technologies, including LLMs, prompt engineering techniques, and comprehensive AI/ML concepts, with specific experience in tools like Vertex AI.
• In-depth knowledge of various data modelling methodologies, robust data governance principles, metadata management, and data quality best practices.
• Hands-on experience with cloud data warehousing solutions such as Snowflake, Redshift, and Synapse, alongside proficiency in Big Data technologies like BigQuery, Dataflow, and Dataproc, and strong SQL skills.
• Exceptional problem-solving, strategic thinking, and leadership capabilities, combined with excellent communication skills and a proven track record of delivering enterprise-scale data solutions.

What We Offer

• An unparalleled opportunity to work on challenging, high-impact projects at the very forefront of Big Data Engineering and Generative AI.
• A highly collaborative, innovative, and intellectually stimulating work environment at Tiger Analytics, fostering continuous learning and significant professional growth.
• Exposure to a diverse portfolio of clients and industries, allowing you to broaden your expertise and enhance your leadership capabilities as a Big Data Engineering Tech SME - Databricks.
• A competitive compensation package and comprehensive benefits, meticulously aligned with industry standards for senior technical leadership roles.
• Be an integral part of a forward-thinking team dedicated to shaping the future of data and artificial intelligence.

If you are a visionary Big Data Engineering Tech SME - Databricks with a fervent passion for transforming complex data landscapes into intelligent, actionable insights, we invite you to take the next step in your career. Join Tiger Analytics and help us engineer the next generation of data-driven solutions.

Locations: Chennai, Bengaluru, Hyderabad, India.

To apply or refer a suitable candidate, please share your resume directly with Sandeep Dhoundiyal at sandeep.dhoundiy@tigeranalytics.com.