Red Hat, a global leader in enterprise open-source software, is seeking a Senior Machine Learning Engineer to join our innovative Inference team. As a Senior Machine Learning Engineer, you will work on cutting-edge vLLM systems and large language models (LLMs), building scalable and high-performance AI solutions for enterprise clients. This role offers the opportunity to optimize inference algorithms, contribute to open-source projects, and influence the future of AI deployments. The Senior Machine Learning Engineer will collaborate with engineers and researchers to create robust, efficient software platforms that accelerate GenAI adoption across industries, combining deep technical expertise with impactful real-world results.
Key Responsibilities
-
Develop and maintain high-performance Python and C++ codebases for vLLM systems.
-
Design, implement, and optimize inference algorithms to enhance efficiency and scalability.
-
Conduct performance analysis to identify bottlenecks and improve system throughput.
-
Participate in technical discussions and propose innovative solutions for AI deployment challenges.
-
Review code, provide feedback, and mentor junior engineers to promote technical excellence.
-
Collaborate across teams to integrate new features and enhance existing infrastructure.
Required Qualifications
-
Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or related field; PhD preferred.
-
Extensive experience developing high-performance code for GPUs and optimizing kernels for deep neural networks.
-
Strong understanding of computer architecture, parallel processing, and distributed computing.
-
Proficiency with tensor math libraries such as PyTorch.
-
Knowledge of high-performance networking protocols like UCX, RoCE, InfiniBand, and RDM.
-
Excellent communication skills for collaboration with both technical and non-technical teams.
Preferred Skills & Experience
-
Demonstrated ability to optimize large-scale AI systems for enterprise deployment.
-
Experience mentoring junior engineers and fostering a culture of technical excellence.
-
Familiarity with open-source AI tools and libraries.
Benefits & Perks
-
Comprehensive medical, dental, and vision insurance coverage.
-
Flexible Spending Account (FSA) and Health Savings Account (HSA) options.
-
Retirement plan with employer 401(k) matching contributions.
-
Paid time off, holidays, and parental leave.
-
Employee stock purchase plan, tuition reimbursement, family planning reimbursement, and transportation support.
-
Employee assistance program for personal and professional support.
Equal Opportunity Commitment
Red Hat is an equal opportunity workplace and affirmative action employer. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, veteran status, disability, or any other legally protected status.