Senior MlOps Engineer

Senior MlOps Engineer

Data Science is all about breaking new ground to enable businesses to answer their most urgent questions. Pioneering massively parallel data-intensive analytic processing, our mission is to develop a whole new approach to generating meaning and value from petabyte-scale data sets and shape brand new methodologies, tools, statistical methods and models. What’s more, we are in collaboration with leading academics, industry experts and highly skilled engineers to equip our customers to generate sophisticated new insights from the biggest of big data.

Join us to do the best work of your career and make a profound social impact as a Senior Advisor, Machine Learning Engineer on our Machine Learning Engineer Team in India (Bangalore/ Gurgaon/ Hyderabad).

What you’ll achieve

As an AI/ML Engineer specializing in LLMOps, you will be integral to deploying sophisticated General/Generative AI solutions, ensuring their operational efficiency, scalability, and responsible use. Engage in innovative projects that leverage massive datasets and state-of-the-art language models to drive decision-making and operational efficiencies across global platforms.

You will:

• Architect and scale machine learning and large language models for efficient deployment across various platforms, implementing LLMOps best practices.
• Build and optimize data pipelines to operationalize ML and LLM models at scale, including advanced prompt engineering techniques and LLM guardrails.
• Develop and deploy LLM-based multi-agent systems, ensuring scalability and efficient communication between agents.
• Work collaboratively with data scientists to refine algorithms and models based on performance metrics and implement human feedback loops and RLHF processes.
• Develop APIs, SDKs, and LLM chains/pipelines to enable seamless interaction with deployed models, incorporating ethical AI principles.
• Implement Docker containers, orchestrate load balancing, and manage LLM-specific infrastructure to optimize resource allocation and utilize vector databases for efficient data handling, retrieval, and context management in LLM/RAG applications.

Take the first step towards your dream career
Every Dell Technologies team member brings something unique to the table. Here’s what we are looking for with this role:

Essential Requirements

• Masters/ Bachelors with 8+ years of relevant experience with mastery in data science platforms (such as Microsoft Azure, AWS, Google Cloud) for building and deploying ML and LLM models, with expertise in LLMOps best practices.
• Proficient in object-oriented programming languages and LLM-specific frameworks such as LangChain, LangGraph, LlamaIndex, with experience in prompt engineering
• Significant software engineering experience with a focus on ML/LLM model production, scalability in low-latency environments, and responsible AI implementation.
• Advanced understanding of Docker, Kubernetes, cloud-native computing, DevOps, data/LLM response streaming, and parallelized workloads for ML and LLM deployments.
• Knowledge of vector databases, LLM fine-tuning techniques, and implementation of LLM guardrails along with experience in LLM operations, including Retrieval-Augmented Generation, Chatbot and multi-agent system deployments (CrewAI, AutoGen, LangGraph).

Desirable Requirements

• Experience in Data Engineering (Spark), Message Queues (RabbitMQ, Kafka) & languages like Python, SQL, C++, R.
• Proficiency in databases (Postgres, MongoDB, SQL Server, Redis) and their optimization for ML/LLM workloads, including vector databases for efficient context retrieval.

Who we are

We believe that each of us has the power to make an impact. That’s why we put our team members at the center of everything we do. If you’re looking for an opportunity to grow your career with some of the best minds and most advanced tech in the industry, we’re looking for you.

Dell Technologies is a unique family of businesses that helps individuals and organizations transform how they work, live and play. Join us to build a future that works for everyone because Progress Takes All of Us.

Application closing date: 30 Aug 2024

Dell Technologies is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. Read the full Equal Employment Opportunity Policy here.