- Databricks Inc. (San Francisco, CA)
- Staff Software Engineer - GenAI inference P-1285 About This Role As a staff software engineer for GenAI inference , you will lead the ... low latency, and robust scaling. Your work will encompass the full GenAI inference stack: kernels, runtimes, orchestration, memory, and integration with… more
- Menlo Ventures (San Francisco, CA)
- About This Role As a software engineer for GenAI inference , you will help design, develop, and optimize the inference engine that powers Databricks' ... scalable, and efficient. Your work will touch the full GenAI inference stack - from kernels and...BS/MS/PhD in Computer Science, or a related field Strong software engineering background (3+ years or equivalent) in performance‑critical… more
- Databricks Inc. (San Francisco, CA)
- A leading AI-focused technology company in San Francisco is seeking a Software Engineer for GenAI inference . In this role, you'll design, develop, and ... optimize the inference engine powering the Foundation Model API. You will...focusing on large-scale LLM applications. A strong background in software engineering, distributed systems, and machine learning techniques is… more
- Databricks Inc. (San Francisco, CA)
- A leading data and AI company in San Francisco seeks a Staff Software Engineer for GenAI inference to lead its architecture and optimization efforts. ... with at least 6 years of experience and an understanding of ML inference internals. Key tasks include collaborating on model features, optimizing the inference… more
- Amazon (San Francisco, CA)
- Senior Software Development Engineer , AI/ML, AWS Neuron, Model Inference Job ID: 3067759 | Amazon.com Services LLC The Annapurna Labs team at Amazon Web ... Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep... development kit used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia… more
- Amazon (San Francisco, CA)
- Software Development Engineer , AI/ML, AWS Neuron, Model Inference The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software ... development kit used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia and Trainium. The AWS Neuron SDK,… more
- Menlo Ventures (San Francisco, CA)
- About This Role As a staff software engineer for GenAI Performance and Kernel, you will own the design, implementation, optimization, and correctness of the ... high-performance GPU kernels powering our GenAI inference stack. You will lead development of highly-tuned, low-level compute paths, manage trade-offs between… more
- harvey.ai (San Francisco, CA)
- … GenAI ‑native applications - such as supporting high‑throughput model inference , managing streaming and long‑running API interactions, and designing abstractions ... today - and we're just getting started. Role Overview As a Backend Platform Engineer at Harvey, you will help build and operate the cohesive backend platform that… more
- Icon Ventures (San Francisco, CA)
- …learning coach that's recognized as best‑in‑class. About the Role As an Applied AI Engineer , you will be working at the forefront of our AI strategy, shaping ... roadmap for applied AI across personalization, ranking, search, recommendations, and GenAI /LLM systems; help connect modeling work to business metrics (engaged… more
- Highlight US Inc (San Francisco, CA)
- Job Title: Senior Machine Learning Engineer / Researcher Location: NYC or SF (On-site) About Highlight AI Highlight AI is a cutting-edge desktop assistant designed ... our team. The Role As a Senior Machine Learning Engineer , you will drive the design, development, and deployment...who's excited to work at the intersection of desktop software , native development, and AI integration, and who thrives… more
- Icon Ventures (San Francisco, CA)
- …coach that's recognized as best‑in‑class. About the Role As Sr. Staff Applied AI Engineer , you will be the hands‑on technical leader shaping Quizlet's AI products in ... roadmap for applied AI spanning personalization, ranking, search, recommendations, and GenAI /LLM systems; tie modeling work directly to business metrics (engaged… more
- Amazon (San Francisco, CA)
- ML Kernel Performance Engineer , AWS Neuron, Annapurna Labs The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit ... used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia and Trainium. The Acceleration Kernel Library team… more
- Rivian (Palo Alto, CA)
- …challenges of electric vehicles through technology that will set the standards for software ‑defined vehicles around the world. The road to the future is uncharted. ... more intelligent, more sustainable for everyone. Role Summary As an ML Ops Engineer , you will be instrumental in building and maintaining a scalable training and… more
- Rubrik, Inc. (Palo Alto, CA)
- …infrastructure - including model gateways (like LiteLLM or MCP), fine‑tuning, inference optimization, or policy enforcement in AI workloads. Strong programming ... Rubrik's offerings also include Predibase to help further secure and deploy GenAI while delivering exceptional accuracy and efficiency for agentic applications. At… more
- Spectro Cloud (San Jose, CA)
- …a pivotal role in shaping the future of our cutting‑edge Palette platform. As a software engineer within our organization, you will be at the forefront of ... enterprise Kubernetes management platform offered by Spectro Cloud. Qualities As a software engineer at Spectro Cloud, you'll succeed by embracing adaptability,… more
- DataRobot (San Francisco, CA)
- …that makes sense for their business - today and in the future. As a Principal Software Engineer for Generative AI at DataRobot, you will be the technical anchor ... & Libraries, LLM Onboarding,Tools, Multi-Agent Evaluations, Multimodality, etc.) and GenAI systems (eg Inference optimization, Distributed Training, Finetuning,… more
- Google (Mountain View, CA)
- Senior Software Engineer , Backend and AI Systems, Flow _corporate_fare_ Google _place_ Mountain View, CA, USA; New York, NY, USA **Mid** Experience driving ... years of experience with ML infrastructure (eg, model deployment, inference , data processing, debugging). **Preferred qualifications:** + Master's degree...goes on and is growing every day. As a software engineer , you will work on a… more
- Amazon (Palo Alto, CA)
- …strong entrepreneurial spirit and bias for action. We are looking for a talented Software Engineer with a strong background in machine learning engineering to ... the future of advertising. Key job responsibilities As a Software Development Engineer in Machine Learning, you...inference systems. * Pioneer the development of LLM inference infrastructure to support next-generation GenAI workloads… more
- Meta (Menlo Park, CA)
- …space of GenAI /LLM scaling reliability and performance. **Required Skills:** Software Engineer , SystemML - Scaling / Performance Responsibilities: 1. ... role, you will be a member of the Network.AI Software team and part of the bigger DC networking...and innovations to leverage our large-scale GPU training and inference fleet through an observable, reliable and high-performance distributed… more
- Zscaler (San Jose, CA)
- …and agility with a cloud-first strategy. We're looking for an experienced Sr. Staff Software Engineer to join our Digital Experience team. This role is hybrid ... building frameworks for all products + Evaluate and integrate state-of-the-art GenAI advances (eg, LLMs/SLMs, retrieval, fine-tuning, inference optimization) to… more
