- Google (Sunnyvale, CA)
- Senior Software Engineer , Inference Team, AI/ML _corporate_fare_ Google _place_ Sunnyvale, CA, USA; Kirkland, WA, USA; +2 more; +1 more **Mid** ... and mobile; the list goes on and is growing every day. As a software engineer , you will work on a specific project critical to Google's needs with opportunities… more
- NVIDIA (Santa Clara, CA)
- NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, ... NVIDIA's inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions. + Work with cross-collaborative teams across frameworks, NVIDIA libraries… more
- NVIDIA (Santa Clara, CA)
- NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, ... and optimize the GPU-accelerated software that powers today's most sophisticated AI applications. Our...inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions. + Work with cross-collaborative teams across frameworks,… more
- MongoDB (Palo Alto, CA)
- …AI-powered applications. **About the Role** We're looking for a Senior Engineer to help build the next-generation inference platform that supports embedding ... transform, and disrupt industries by unleashing the power of software and data. We enable organizations of all sizes...with Atlas and designed for developer-first experiences. As a Senior Engineer , you'll focus on building core… more
- NVIDIA (Santa Clara, CA)
- …team and see how you can make a lasting impact on the world. We are seeking a Senior Software Engineer to join our Software Infrastructure Team in Santa ... role, you will be a key contributor to our Inference as a Service platform, developing the systems that...related fields (or equivalent experience) + 12+ years of software engineering experience with expertise in distributed systems or… more
- NVIDIA (Santa Clara, CA)
- …and engineering teams alike developing best-in-class AI models. We are now looking for a Senior Deep Learning Software Engineer to develop and scale up our ... innovate on the inference performance to ensure NVIDIA's inference software solutions (TRT, TRT-LLM, TRT Model Optimizer) can maintain and increase… more
- NVIDIA (Santa Clara, CA)
- …deep learning inference software for NVIDIA AI accelerators. As a Senior Software Engineer in the TensorRT team, you will be responsible ... for designing and implementing inference software optimizations to power AI applications on NVIDIA GPUs. If you're ready to take on challenging projects and make… more
- NVIDIA (Santa Clara, CA)
- …and eager to work on cutting-edge AI technology? Join NVIDIA's TensorRT team as a Senior Software Engineer , and be at the forefront of technology, enabling ... with teams and stakeholders across the whole hardware and software stack to understand and leverage new features to...models (such as Large Language Models) & frameworks for inference . + Background with C++17. NVIDIA is widely considered… more
- Amazon (Cupertino, CA)
- …The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon's ... with popular ML frameworks like PyTorch and JAX enabling unparalleled ML inference and training performance. The Inference Enablement and Acceleration team… more
- Amazon (Cupertino, CA)
- …The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon's ... with popular ML frameworks like PyTorch and JAX enabling unparalleled ML inference and training performance. The Inference Enablement and Acceleration team… more
- Amazon (Cupertino, CA)
- …accelerators and servers that use them. This role is for a software engineer in the Machine Learning Inference Model Enablement team for AWS Neuron at ... Description AWS Neuron is the complete software stack for the AWS Inferentia and Trainium...as stable diffusion, vision transformers and many more. The Inference Model Enablement team works side by side with… more
- NVIDIA (Santa Clara, CA)
- …streamlined deployment strategies with open-sourced inference frameworks. Seeking a Senior Deep Learning Algorithms Engineer to improve innovative generative ... as large language models (LLM) and diffusion models for maximal inference efficiency using techniques ranging from quantization, speculative decoding, sparsity,… more
- NVIDIA (Santa Clara, CA)
- We are now looking for a Senior DL Algorithms Engineer ! NVIDIA is seeking senior engineers who are mindful of performance analysis and optimization to help ... are unafraid to work across all layers of the hardware/ software stack from GPU architecture to Deep Learning Framework...will be doing: + Implement language and multimodal model inference as part of NVIDIA Inference Microservices… more
- NVIDIA (Santa Clara, CA)
- … software ecosystem to power AI at scale. We are looking for a Senior Technical Marketing Engineer to join our growing accelerated computing product team. ... ensure a consistent, high-impact go-to-market strategy. This role will focus on AI inference at scale, ensuring that customers and partners understand how to best… more
- Amazon (Cupertino, CA)
- …and the Trn1 and Inf1 servers that use them. This role is for a software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. ... Description AWS Neuron is the complete software stack for the AWS Inferentia and Trainium...and runtime engineers to create, build and tune distributed inference solutions with Trn1. Experience optimizing inference … more
- NVIDIA (Santa Clara, CA)
- We are now looking for a Senior Deep Learning Software Engineer , LLM Performance! NVIDIA is seeking an experienced Deep Learning Engineer passionate ... set of teams involving performance modeling, performance analysis, kernel development and inference software development. What you'll be doing: + Performance… more
- NVIDIA (Santa Clara, CA)
- We are looking for a skilled Open Source Software Developer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining ... NVIDIA Models and Inference API integrations into open-source inference libraries...or equivalent experience + 8+ years of experience in software design, development and test + Experience in open… more
- Walmart (Sunnyvale, CA)
- …skills, strategic planning, system design ability, and mentorship. **What you'll do ** As a ** Senior Software Engineer - Machine Learning** , you are a ... **Position Summary ** As a Senior Machine Learning Engineer , you are...leader working at the intersection of machine learning and software engineering. You have expertise in both areas and… more
- NVIDIA (Santa Clara, CA)
- We are now looking for a Senior Deep Learning Software Engineer , FlashInfer. NVIDIA has been transforming computer graphics, PC gaming, and accelerated ... looking for outstanding AI systems engineers to develop groundbreaking technologies in the inference systems software stack! We build innovative AI systems … more
- NVIDIA (Santa Clara, CA)
- …platform upon which every new AI-powered application is built. We are seeking a Senior Software Engineer focused on container and cloud infrastructure. You ... will help design and implement our core container strategy for NVIDIA Inference Microservices (NIMs) and our hosted services. You will build enterprise-grade … more