- Capital One Bank (Newport News, VA)
- Senior Lead Software Engineer , Distributed Systems (Go, Java, Kubernetes, AWS)The Capital One machine learning platform organization manages our cloud-based ... real-time and batch processing workloads. We are seeking a Senior Lead Software engineer , who...ranging from developer notebooks to model training to model inference and feature generation pipelines to pre-training and fine… more
- Capital One Bank (Washington, DC)
- …developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, ... Senior AI Engineer (LLM Core)Overview:At Capital...with Capital One.Design, develop, test, deploy, and support AI software components including foundation model training, large language model… more
- NVIDIA (Santa Clara, CA)
- We are now looking for a Senior Software Engineer for Deep Learning Inference Workflows! Would you like to make a big impact in Deep Learning by helping ... build a state-of-the-art inference framework for accelerating Deep Learning models, especially Large...Models, on NVIDIA GPUs? We are now welcoming exceptional software engineers to apply to Senior Engineering… more
- NVIDIA (Santa Clara, CA)
- NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, ... NVIDIA's inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions. + Work with cross-collaborative teams across frameworks, NVIDIA libraries… more
- NVIDIA (Santa Clara, CA)
- NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, ... and optimize the GPU-accelerated software that powers today's most sophisticated AI applications. Our...inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions. + Work with cross-collaborative teams across frameworks,… more
- MongoDB (Seattle, WA)
- …AI-powered applications. **About the Role** We're looking for a Senior Engineer to help build the next-generation inference platform that supports embedding ... transform, and disrupt industries by unleashing the power of software and data. We enable organizations of all sizes...with Atlas and designed for developer-first experiences. As a Senior Engineer , you'll focus on building core… more
- NVIDIA (Santa Clara, CA)
- …team and see how you can make a lasting impact on the world. We are seeking a Senior Software Engineer to join our Software Infrastructure Team in Santa ... role, you will be a key contributor to our Inference as a Service platform, developing the systems that...related fields (or equivalent experience) + 12+ years of software engineering experience with expertise in distributed systems or… more
- NVIDIA (CA)
- …see how you can make a lasting impact on the world. We are now looking for a Senior System Software Engineer to work on user facing tools for Dynamo ... Inference Server! NVIDIA is hiring software engineers for its GPU-accelerated deep learning software team, and we are a remote friendly work environment.… more
- NVIDIA (Santa Clara, CA)
- …and engineering teams alike developing best-in-class AI models. We are now looking for a Senior Deep Learning Software Engineer to develop and scale up our ... innovate on the inference performance to ensure NVIDIA's inference software solutions (TRT, TRT-LLM, TRT Model Optimizer) can maintain and increase… more
- NVIDIA (Santa Clara, CA)
- …deep learning inference software for NVIDIA AI accelerators. As a Senior Software Engineer in the TensorRT team, you will be responsible ... for designing and implementing inference software optimizations to power AI applications on NVIDIA GPUs. If you're ready to take on challenging projects and make… more
- NVIDIA (Santa Clara, CA)
- …and eager to work on cutting-edge AI technology? Join NVIDIA's TensorRT team as a Senior Software Engineer , and be at the forefront of technology, enabling ... with teams and stakeholders across the whole hardware and software stack to understand and leverage new features to...models (such as Large Language Models) & frameworks for inference . + Background with C++17. NVIDIA is widely considered… more
- NVIDIA (CA)
- We are now looking for a Senior System Software Engineer to work on Dynamo & Triton Inference Server! NVIDIA is hiring software engineers for its ... What you'll be doing: In this role, you will develop open source software to serve inference of trained AI models running on GPUs. You will balance a variety… more
- Amazon (Seattle, WA)
- …machine learning accelerators. This role is for a senior software engineer in the Machine Learning Inference Applications team. This role is responsible ... Description AWS Neuron is the complete software stack for the AWS Inferentia and Trainium...and performance optimization of core building blocks of LLM Inference - Attention, MLP, Quantization, Speculative Decoding, Mixture of… more
- Amazon (Seattle, WA)
- …machine learning accelerators. This role is for a senior software engineer in the Machine Learning Inference Applications team. This role is responsible ... Description AWS Neuron is the complete software stack for the AWS Inferentia and Trainium...and performance optimization of core building blocks of LLM Inference - Attention, MLP, Quantization, Speculative Decoding, Mixture of… more
- Amazon (Seattle, WA)
- …The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon's ... with popular ML frameworks like PyTorch and JAX enabling unparalleled ML inference and training performance. The Inference Enablement and Acceleration team… more
- Amazon (Cupertino, CA)
- …accelerators and servers that use them. This role is for a software engineer in the Machine Learning Inference Model Enablement team for AWS Neuron at ... Description AWS Neuron is the complete software stack for the AWS Inferentia and Trainium...as stable diffusion, vision transformers and many more. The Inference Model Enablement team works side by side with… more
- Google (Kirkland, WA)
- Staff Software Engineer , Generative AI Inference _corporate_fare_ Google _place_ Seattle, WA, USA; Kirkland, WA, USA **Advanced** Experience owning outcomes ... us make GKE the leading cost-effective, simplified, and fastest platform for running GenAI inference workloads. As a Software Engineer , you will joining the… more
- NVIDIA (Santa Clara, CA)
- …streamlined deployment strategies with open-sourced inference frameworks. Seeking a Senior Deep Learning Algorithms Engineer to improve innovative generative ... as large language models (LLM) and diffusion models for maximal inference efficiency using techniques ranging from quantization, speculative decoding, sparsity,… more
- NVIDIA (Santa Clara, CA)
- We are now looking for a Senior DL Algorithms Engineer ! NVIDIA is seeking senior engineers who are mindful of performance analysis and optimization to help ... are unafraid to work across all layers of the hardware/ software stack from GPU architecture to Deep Learning Framework...will be doing: + Implement language and multimodal model inference as part of NVIDIA Inference Microservices… more
- NVIDIA (Santa Clara, CA)
- … software ecosystem to power AI at scale. We are looking for a Senior Technical Marketing Engineer to join our growing accelerated computing product team. ... ensure a consistent, high-impact go-to-market strategy. This role will focus on AI inference at scale, ensuring that customers and partners understand how to best… more
