MCP Server Engineer

EXL is actively seeking an experienced MCP Server Engineer to join our dynamic team. In this pivotal role, you will be responsible for designing, building, and maintaining robust connections between Databricks workspaces and Model Context Protocol (MCP) servers, crucial for enabling advanced AI and Large Language Model (LLM) applications. This is an exciting opportunity for a skilled MCP Server Engineer to work at the forefront of data integration and AI innovation within a collaborative environment.

Key Responsibilities

• Design, build, and maintain secure connectors and data pipelines between Databricks workspaces (including Delta Lake and Unity Catalog) and Model Context Protocol (MCP) servers.
• Implement and configure MCP servers/clients to securely expose Databricks data, schemas, and analytical tools to AI models and LLM applications.
• Optimize data retrieval, caching mechanisms, and query performance between Databricks and LLM orchestration frameworks to minimize latency and ensure efficient data access.
• Ensure that all data exposed through the MCP server strictly adheres to enterprise data governance policies, access controls, and Unity Catalog permissions.
• Collaborate closely with AI/ML engineers, data scientists, and software architects to define the necessary context, tools, and prompts for LLM applications to effectively query Databricks.
• Establish robust logging, comprehensive error-handling, and proactive monitoring for the Databricks - MCP middleware to guarantee high availability and reliability of critical systems.

Requirements

• Proven, hands-on experience in building, configuring, or extending MCP servers using Python or TypeScript/Node.js SDKs to connect AI models like Llama to external data sources.
• Deep production experience with Databricks, including expertise in Delta Lake, Unity Catalog, Databricks SQL, and Managed MLflow.
• Strong understanding and practical experience with Server-Sent Events (SSE), WebSockets, and JSON-RPC 2.0 protocols, which are fundamental to MCP communication.
• Bachelor's degree in Computer Science, Software Engineering, Management Information Systems (MIS), or an equivalent combination of education and relevant experience.
• Ability to work effectively in a fast-paced, collaborative environment and contribute to innovative solutions.

What We Offer

• An opportunity to work on cutting-edge AI and LLM technologies within a leading global analytics and digital solutions company.
• A collaborative and supportive work environment that fosters innovation and professional growth.
• The chance to make a significant impact on critical data infrastructure and AI capabilities.
• Exposure to diverse and complex challenges in data integration and machine learning.
• Continuous learning opportunities and career development within a rapidly evolving technological landscape.