- Databricks Inc. (San Francisco, CA)
- A leading AI-focused technology company in San Francisco is seeking a Software Engineer for GenAI inference . In this role, you'll design, develop, and ... optimize the inference engine powering the Foundation Model API. You will collaborate closely with researchers and engage in performance-critical system challenges,… more
- Databricks Inc. (San Francisco, CA)
- Staff Software Engineer - GenAI inference P-1285 About This Role As a staff software engineer for GenAI inference , you will lead the ... low latency, and robust scaling. Your work will encompass the full GenAI inference stack: kernels, runtimes, orchestration, memory, and integration with… more
- Menlo Ventures (San Francisco, CA)
- About This Role As a software engineer for GenAI inference , you will help design, develop, and optimize the inference engine that powers Databricks' ... our large language model (LLM) serving systems are fast, scalable , and efficient. Your work will touch the full..., and efficient. Your work will touch the full GenAI inference stack - from kernels and… more
- Genentech (San Francisco, CA)
- …and optimise workflows. We also work on scaling up model training and inference , evaluating the quality of AI/ML models and output, and building impactful ... the scientific needs. The Opportunity: As a machine learning engineer in AI Enablement, you will be working closely...everyone in between. You'll build, own, and constantly improve scalable AI/ML based systems that unlock the potential of… more
- Socotra, Inc. (San Francisco, CA)
- Build the Future of Scalable AI at TrueFoundry At TrueFoundry , we're redefining how ML teams train, deploy, and scale their models. Our LLMOps and MLOps platform ... on Kubernetes-with the same muscle as Big Tech. We're looking for an Engineer who is passionate about scaling deep learning workloads, optimizing multi-GPU training,… more
- harvey.ai (San Francisco, CA)
- … GenAI ‑native applications - such as supporting high‑throughput model inference , managing streaming and long‑running API interactions, and designing abstractions ... today - and we're just getting started. Role Overview As a Backend Platform Engineer at Harvey, you will help build and operate the cohesive backend platform that… more
- Amazon (San Francisco, CA)
- …multi‑lingual large language models (LLM). AGI's mission is to leverage our hyper‑ scalable , general‑purpose large model training and inference systems to build ... cluster and node management to ensure smooth operation of GenAI infrastructure. Continuously improve and automate cluster/capacity/maintenance upgrades. Troubleshoot… more
- Rivian (Palo Alto, CA)
- … Engineer , you will be instrumental in building and maintaining a scalable training and inference platform using both Databricks and open‑source technologies. ... Scalable ML Infrastructure: Design and implement a scalable training and inference platform using Databricks and open‑source technologies to support ML/AI… more
- Rivian (Palo Alto, CA)
- …in California seeks an ML Ops Engineer to build and maintain a scalable training and inference platform. The role involves managing ML/AI models, utilizing ... cloud technologies, and collaborating with cross-functional teams. Candidates should have 5+ years in ML Ops, experience with distributed training frameworks, proficiency in programming languages like Python, and a solid background in cloud technologies. This… more
- Rubrik, Inc. (Palo Alto, CA)
- …Innovate at the intersection of AI, security, and distributed systems: Design scalable mechanisms for agent discovery and classification . Contribute to the design ... infrastructure . Experience You'll Need: You are passionate about building secure, scalable AI infrastructure that enables enterprises to safely harness the power of… more
- Spectro Cloud (San Jose, CA)
- …role in shaping the future of our cutting‑edge Palette platform. As a software engineer within our organization, you will be at the forefront of building an ... will stay ahead of emerging AI trends - small models, efficient inference (vLLM/TensorRT), multimodal systems, on‑device LLMs - and recommend tools, frameworks, or… more
- DataRobot (San Francisco, CA)
- …& Libraries, LLM Onboarding,Tools, Multi-Agent Evaluations, Multimodality, etc.) and GenAI systems (eg Inference optimization, Distributed Training, Finetuning, ... today and in the future. As a Principal Software Engineer for Generative AI at DataRobot, you will be...DataRobot, you will be the technical anchor for our GenAI Tooling and Systems teams, shaping the architecture, ensuring… more
- Google (Mountain View, CA)
- Senior Software Engineer , Backend and AI Systems, Flow _corporate_fare_ Google _place_ Mountain View, CA, USA; New York, NY, USA **Mid** Experience driving progress, ... Kotlin, or Go). + 3 years of experience testing, maintaining, or launching scalable software products, 1 year of experience with backend software design and… more
- Honeywell (San Jose, CA)
- We're seeking a highly skilled Artificial Intelligence & Machine Learning Systems Engineer to architect, design, and develop advanced AI/ML systems that power our ... engineering teams, and collaborate with cross-functional teams to deliver intelligent, scalable , and production-ready AI and machine learning technologies. You will… more
- Meta (Menlo Park, CA)
- … GenAI /LLM scaling reliability and performance. **Required Skills:** Software Engineer , SystemML - Scaling / Performance Responsibilities: 1. Enabling reliable ... products and innovations to leverage our large-scale GPU training and inference fleet through an observable, reliable and high-performance distributed AI/GPU… more
- Zscaler (San Jose, CA)
- …building frameworks for all products + Evaluate and integrate state-of-the-art GenAI advances (eg, LLMs/SLMs, retrieval, fine-tuning, inference optimization) to ... agility with a cloud-first strategy. We're looking for an experienced Sr. Staff Software Engineer to join our Digital Experience team. This role is hybrid and based… more
- Amazon (Mountain View, CA)
- …and services, as a Delivery Consultant you will be proficient in architecting complex, scalable , and secure AI/ML and GenAI solutions tailored to meet the ... value through the adoption and automation of Generative AI ( GenAI )? Excited by using massive amounts of disparate data...Professional Services (ProServe) team is seeking a skilled ML Engineer to join our team as a Delivery Consultant… more
- Meta (Menlo Park, CA)
- …products and innovations to leverage our large-scale GPU training and inference fleet through an observable, reliable and high-performance distributed AI/GPU ... to improve the full-stack distributed ML reliability and performance (eg Large-Scale GenAI /LLM training) from the trainer down to the inter-GPU and network… more
