- Databricks Inc. (San Francisco, CA)
- Staff Software Engineer - GenAI inference P-1285 About This Role As a staff software engineer for GenAI inference , you will lead the ... low latency, and robust scaling. Your work will encompass the full GenAI inference stack: kernels, runtimes, orchestration, memory, and integration with… more
- Menlo Ventures (San Francisco, CA)
- About This Role As a software engineer for GenAI inference , you will help design, develop, and optimize the inference engine that powers Databricks' ... scalable, and efficient. Your work will touch the full GenAI inference stack - from kernels and...BS/MS/PhD in Computer Science, or a related field Strong software engineering background (3+ years or equivalent) in performance‑critical… more
- Databricks Inc. (San Francisco, CA)
- A leading AI-focused technology company in San Francisco is seeking a Software Engineer for GenAI inference . In this role, you'll design, develop, and ... optimize the inference engine powering the Foundation Model API. You will...focusing on large-scale LLM applications. A strong background in software engineering, distributed systems, and machine learning techniques is… more
- Databricks Inc. (San Francisco, CA)
- A leading data and AI company in San Francisco seeks a Staff Software Engineer for GenAI inference to lead its architecture and optimization efforts. ... with at least 6 years of experience and an understanding of ML inference internals. Key tasks include collaborating on model features, optimizing the inference… more
- Rivian (Palo Alto, CA)
- …challenges of electric vehicles through technology that will set the standards for software ‑defined vehicles around the world. The road to the future is uncharted. ... more intelligent, more sustainable for everyone. Role Summary As an ML Ops Engineer , you will be instrumental in building and maintaining a scalable training and… more
- Rubrik, Inc. (Palo Alto, CA)
- …infrastructure - including model gateways (like LiteLLM or MCP), fine‑tuning, inference optimization, or policy enforcement in AI workloads. Strong programming ... Rubrik's offerings also include Predibase to help further secure and deploy GenAI while delivering exceptional accuracy and efficiency for agentic applications. At… more
- Apple Inc. (Cupertino, CA)
- …with data, ultimately helping teams derive insights that drive product success. As a Staff GenAI Engineer on the Apple Data Platform group's GenAI Platform ... Cupertino, California, United States Software and Services The Apple Data Platform team...Platform. Description Join Apple's Data Platform as a Staff GenAI Engineer , where you'll be at the… more
- NVIDIA Corporation (Santa Clara, CA)
- NVIDIA is now looking for AI Software Engineers for ourGenAI Frameworks ( and ) team. Megatron Core and NeMo Framework are open-source, scalable and cloud-native ... and Multimodal (MM) foundation model pretraining and post-training. Our GenAI Frameworks provide end-to-end model training, including pretraining, alignment,… more
- Amazon (San Francisco, CA)
- Senior Software Development Engineer , AI/ML, AWS Neuron, Model Inference Job ID: 3067759 | Amazon.com Services LLC The Annapurna Labs team at Amazon Web ... Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep... development kit used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia… more
- Amazon (San Francisco, CA)
- Software Development Engineer , AI/ML, AWS Neuron, Model Inference The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software ... development kit used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia and Trainium. The AWS Neuron SDK,… more
- Menlo Ventures (San Francisco, CA)
- About This Role As a staff software engineer for GenAI Performance and Kernel, you will own the design, implementation, optimization, and correctness of the ... high-performance GPU kernels powering our GenAI inference stack. You will lead development of highly-tuned, low-level compute paths, manage trade-offs between… more
- Spectro Cloud (San Jose, CA)
- …a pivotal role in shaping the future of our cutting‑edge Palette platform. As a software engineer within our organization, you will be at the forefront of ... enterprise Kubernetes management platform offered by Spectro Cloud. Qualities As a software engineer at Spectro Cloud, you'll succeed by embracing adaptability,… more
- Amazon (Cupertino, CA)
- Sr. ML Kernel Performance Engineer , AWS Neuron, Annapurna Labs The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development ... kit used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia and Trainium. The Acceleration Kernel Library… more
- Cisco Systems (Sunnyvale, CA)
- …that power AI across Splunk and Cisco. We manage large-scale, multi-tenant LLM inference across major cloud providers and build platform services to support these ... SDKs, tools, and evaluation/guardrail capabilities that help teams quickly build reliable GenAI assistants and automation features. You'll join a group that sits at… more
- NVIDIA Corporation (Santa Clara, CA)
- …and Multimodal (MM) foundation model pretraining and post-training. Our GenAI Frameworks provide end-to-end model training, including pretraining, reasoning, ... Megatron Core , NeMo Framework Solve large-scale, end-to-end AI training and inference challenges, spanning the full model lifecycle from initial orchestration, data… more
- Amazon (Cupertino, CA)
- The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on ... The AWS Machine Learning accelerators (Inferentia/Trainium) offer unparalleled ML inference and training performances. They are enabled through a state-of-the-art… more
- harvey.ai (San Francisco, CA)
- … GenAI ‑native applications - such as supporting high‑throughput model inference , managing streaming and long‑running API interactions, and designing abstractions ... today - and we're just getting started. Role Overview As a Backend Platform Engineer at Harvey, you will help build and operate the cohesive backend platform that… more
- Icon Ventures (San Francisco, CA)
- …learning coach that's recognized as best‑in‑class. About the Role As an Applied AI Engineer , you will be working at the forefront of our AI strategy, shaping ... roadmap for applied AI across personalization, ranking, search, recommendations, and GenAI /LLM systems; help connect modeling work to business metrics (engaged… more
- Highlight US Inc (San Francisco, CA)
- Job Title: Senior Machine Learning Engineer / Researcher Location: NYC or SF (On-site) About Highlight AI Highlight AI is a cutting-edge desktop assistant designed ... our team. The Role As a Senior Machine Learning Engineer , you will drive the design, development, and deployment...who's excited to work at the intersection of desktop software , native development, and AI integration, and who thrives… more
- Icon Ventures (San Francisco, CA)
- …coach that's recognized as best‑in‑class. About the Role As Sr. Staff Applied AI Engineer , you will be the hands‑on technical leader shaping Quizlet's AI products in ... roadmap for applied AI spanning personalization, ranking, search, recommendations, and GenAI /LLM systems; tie modeling work directly to business metrics (engaged… more
