- Red Hat (Boston, MA)
- …is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and ... optimize, and scale LLM deployments. As a Machine Learning Engineer focused on distributed vLLM (https://github.com/ vllm...components in Go and/or Rust to integrate with the vLLM project and manage distributed inference workloads.… more
- Red Hat (Boston, MA)
- …open, and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. The Red Hat Inference team accelerates AI for the enterprise ... optimize, and scale LLM deployments. As a Machine Learning Engineer focused on vLLM , you will be...you. Join us in shaping the future of AI Inference ! **What You Will Do** + Write robust Python… more
- Red Hat (Boston, MA)
- …is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and ... project (https://github.blog/news-insights/octoverse/octoverse-a-new-developer-joins-github-every-second-as-ai-leads-typescript-to-1/#the-top-open-source-projects-by-contributors) on Github. As a Machine Learning Engineer focused on vLLM , you will… more
- Red Hat (Boston, MA)
- …is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and ... to GenAI deployments. As leading developers, maintainers of the vLLM project, and inventors of state-of-the-art techniques for model...scale LLM deployments. We are seeking an experienced Senior ML Ops engineer to work closely with… more
- Red Hat (Boston, MA)
- …Nsight Systems, PyTorch Profiler, among others + Hands-on experience with modern LLM inference server stacks (eg, vLLM , TensorRT-LLM, TGI, Triton Inference ... and Scale Engineering team is seeking a Senior Performance Engineer to join our PSAP (Performance and Scale for...you will drive the performance and scalability of distributed inference for Large Language Models (LLMs) as part of… more
- Oracle (Boston, MA)
- …that integrate seamlessly with cloud services. Role Summary As a Principal Software Engineer (IC4), you will contribute to the design and implementation of scalable, ... workflows. You will work in a collaborative environment with applied scientists, ML engineers, and software teams to deliver performant and reliable AI… more