- Databricks Inc. (San Francisco, CA)
- …data and AI company in San Francisco seeks a Staff Software Engineer for GenAI inference to lead its architecture and optimization efforts. Candidates should ... with at least 6 years of experience and an understanding of ML inference internals. Key tasks include collaborating on model features, optimizing the inference… more
- Databricks Inc. (San Francisco, CA)
- Staff Software Engineer - GenAI inference P-1285 About This Role As a staff software engineer for GenAI inference , you will lead the architecture, ... low latency, and robust scaling. Your work will encompass the full GenAI inference stack: kernels, runtimes, orchestration, memory, and integration with… more
- Amazon (San Francisco, CA)
- Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference Job ID: 3067759 | Amazon.com Services LLC The Annapurna Labs team at Amazon Web Services ... Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia and Trainium.… more
- Amazon (San Francisco, CA)
- Software Development Engineer, AI/ML, AWS Neuron, Model Inference The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development ... kit used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia...ML frameworks like PyTorch and JAX enabling unparalleled ML inference and training performance. The Inference Enablement… more
- Icon Ventures (San Francisco, CA)
- …Experience building on a modern MLOps stack (feature mgmt, orchestration, streaming, online inference at scale ) Compensation, Benefits & Perks Quizlet is an ... us to design and deliver AI-powered learning tools that scale across the world and unlock human potential. About...that boost learner outcomes and creator productivity. You will architect and ship a variety of models and modeling… more
- Anzen Technologies, Inc. (San Francisco, CA)
- …evaluating results and rolling them out with the appropriate infrastructure. Architect production‑grade systems that marry real‑time inference with ... best investors in the world, and are continuing to scale our team in Mexico, Canada, and the United...Broad ML toolbox, from classic ML (especially NLP) to GenAI . Strong backend fundamentals: distributed systems, streaming data pipelines.… more
- Amazon (San Francisco, CA)
- …Proof Of Concepts advancing the state of the art in AI & ML for GenAI . Collaborate with cross-functional teams to architect and execute technically rigorous AI ... core capabilities, ensuring a seamless and intuitive user experience. Develop new inference and training techniques to improve the performance of Large Language… more
- Rubrik, Inc. (Palo Alto, CA)
- …- streaming telemetry, audit trails, and behavioral analytics across thousands of agents. Architect and scale systems that handle millions of agent decisions per ... possible for organizations to operate production‑grade AI agents at scale . As a member of the Rubrik Agent Cloud...- including model gateways (like LiteLLM or MCP), fine‑tuning, inference optimization, or policy enforcement in AI workloads. Strong… more
