- MongoDB (Palo Alto, CA)
- **About the Role** We're looking for a Senior Engineer to help build the next-generation inference platform that supports embedding models used for ... with Atlas and designed for developer-first experiences. As a Senior Engineer , you'll focus on building core...Do** + Design and build components of a multi-tenant inference platform integrated directly with MongoDB Atlas,… more
- Red Hat (Boston, MA)
- …bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI ... techniques for model quantization and sparsification, our team provides a stable platform for enterprises to build, optimize, and scale LLM deployments. As a… more
- NVIDIA (Santa Clara, CA)
- …streamlined deployment strategies with open-sourced inference frameworks. Seeking a Senior Deep Learning Algorithms Engineer to improve innovative generative ... optimization, parallelism strategies). + Drive continuous innovation in deep learning inference performance to strengthen NVIDIA platform integration and expand… more
- Bank of America (Addison, TX)
- Senior Engineer -AI Inference Addison, Texas;Plano, Texas; Newark, Delaware; Charlotte, North Carolina; Kennesaw, Georgia **To proceed with your application, ... must be at least 18 years of age.** Acknowledge (https://ghr.wd1.myworkdayjobs.com/Lateral-US/job/Addison/ Senior - Engineer -AI- Inference \_25029879) **Job Description:** At Bank… more
- NVIDIA (CA)
- We are now looking for a Senior System Software Engineer to work on Dynamo & Triton Inference Server! NVIDIA is hiring software engineers for its ... role, you will develop open source software to serve inference of trained AI models running on GPUs. You...you. Come help us build the real-time, efficient computing platform driving our success in the multifaceted and quickly… more
- Red Hat (Boston, MA)
- …bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI ... techniques for model quantization and sparsification, our team provides a stable platform for enterprises to build, optimize, and scale LLM deployments. You would… more
- Red Hat (Boston, MA)
- …for enterprises to build, optimize, and scale LLM deployments. We are seeking an experienced Senior ML Ops engineer to work closely with our product and research ... open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings...deep learning products and software. As an ML Ops engineer , you will work closely with our technical and… more
- quadric.io, Inc (Burlingame, CA)
- …executes both NN graph code and conventional C++ DSP and control code. Role: The AI Inference Engineer in Quadric is the key bridge between the world of AI/LLM ... models and Quadric unique platforms. The AI Inference Engineer at Quadric will [1] port...platform ; [2] optimize the model deployment for efficient inference ; [3] profile and benchmark the model performance. This… more
- NVIDIA (Durham, NC)
- … Senior Deep Learning Inference Performance Architect! NVIDIA is seeking a Senior Performance Architect - a creative engineer who loves to squeeze out ... every cycle of performance from deep learning software. The Inference Architecture team does groundbreaking hardware-software co-design work that focuses on… more
- Capital One (New York, NY)
- Senior AI Engineer (Gen AI Platform Services, Agentic Systems) **Overview:** At Capital One, we are creating responsible and reliable AI systems, changing ... agreed upon number of hours to be regularly worked. Cambridge, MA: $158,600 - $181,000 for Senior AI Engineer McLean, VA: $158,600 - $181,000 for Senior AI … more
- DoorDash (San Francisco, CA)
- …platforms, including both the theoretical and engineering aspects, products including A/B testing platform , Causal Inference platform and Adaptive Learning ... About the Team The Experimentation Platform team develops an industry-leading platform ...platform (RL/MAB) + Expand the statistical and causal inference algorithms to support large-scale experimentation volume and computation… more
- PennyMac (Westlake Village, CA)
- …achieve aspirations of homeownership through the complete mortgage journey. A Typical Day The Senior AI Platform Engineer will: + Design, implement, and ... (NYSE: PFSI) is a specialty financial services firm with a comprehensive mortgage platform and integrated business focused on the production and servicing of US… more
- LinkedIn (Mountain View, CA)
- …to optimize their models and deliver the best performance possible. As a Senior Software Engineer , you will have first-hand opportunities to advance one ... billions of user queries. Model Training Infrastructure: As an engineer on the AI Training Infra team, you will...shapes the future of AI with the state-of-the-art Feature Platform , which empowers AI Users to effortlessly create, compute,… more
- Coinbase (Topeka, KS)
- …Finhub), Machine Learning, Customer Experience, and Infrastructure. We are looking for a Senior Machine Learning Platform Engineer to join our Machine ... us, every day, as we build the emerging onchain platform - and with it, the future global financial...standards to maintain high-availability and low-latency for our ML inference infrastructure that runs both predictive ML models and… more
- pony.ai (Fremont, CA)
- …globally. Pony.ai went public at NASDAQ in November 2024. Responsibilities As a ( Senior ) Kubernetes Engineer , you will: + Design, operate, and optimize ... low-latency inference services. + Develop, maintain, and extend Kubernetes platform features (operators, CRDs, APIs) to automate and productize internal use… more
- Cargill (Atlanta, GA)
- …day. Join us and reach your higher purpose at Cargill. **Job Purpose and Impact** The Senior AI Platform Engineer for AI Assistants & AI Agents keeps ... Cargill's enterprise AI-assistant platform (ChatGPT Enterprise, M365 Copilots, agentic-automation runtime) safe, up-to-date, and high-performing. You will own… more
- NVIDIA (Santa Clara, CA)
- We're building the infrastructure that powers GR00T, NVIDIA's general-purpose humanoid robotics platform . This is not a typical DevOps job. You'll help engineer ... GPUs. We're looking for a pragmatic Kubernetes-native backend and infrastructure engineer who excels in solving complex orchestration problems in distributed AI/ML… more
- JPMorgan Chase (Jersey City, NJ)
- …the envelope to enhance, build, and deliver top-notch technology products. As a Senior Lead Software Engineer at JPMorgan Chase within the Corporate Sector, ... machine learning concepts, including transformer architecture, ML training, and inference . + Experience in solutions design and engineering, containerization… more
- Palo Alto Networks (Santa Clara, CA)
- …formidable security posture from development through runtime. As a Principal Machine Learning Inference Engineer , you will serve as a technical authority and ... Design: Lead the architectural design of a highly scalable, low-latency, and resilient ML inference platform capable of serving a diverse range of models for… more
- Palo Alto Networks (Santa Clara, CA)
- …an environment where we all win with precision. **Your Career** As a Principal AI Engineer for the Enterprise AI Platform , you will be a pivotal technical leader ... ensuring the platform 's ability to handle massive scale data and inference requests, optimizing for low latency and high throughput for real-time AI applications… more