- Bank of America (Addison, TX)
- Senior Engineer - AI Inference Addison, Texas;Charlotte, North Carolina; Kennesaw, Georgia; Newark, Delaware **To proceed with your application, you must ... must be at least 18 years of age.** Acknowledge (https://ghr.wd1.myworkdayjobs.com/Lateral-US/job/Addison/ Senior - Engineer - AI - Inference \_25029879) **Job Description:**… more
- NVIDIA (Santa Clara, CA)
- We're now seeking a Senior AI Software Engineer , in our LLM Inference Performance Analysis and Optimization team! NVIDIA leads the generative AI ... We're now seeking an experienced AI Software Engineer to optimize LLM inference performance. Our team collaborates with compiler, kernel, hardware, and… more
- NVIDIA (CA)
- …distributed model management systems, including Rust-based runtime components, for large-scale AI inference workloads. + Implement inference scheduling ... people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An...on the world. We are now looking for a Senior System Software Engineer to work on… more
- NVIDIA (Santa Clara, CA)
- …seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You'll ... architect and implement high-performance inference stacks, optimize GPU kernels and compilers, drive industry...teams to push the frontier of accelerated computing for AI . What you'll be doing: + Contribute features to… more
- NVIDIA (Santa Clara, CA)
- …software ecosystem to power AI at scale. We are looking for a Senior Technical Marketing Engineer to join our growing accelerated computing product team. ... ensure a consistent, high-impact go-to-market strategy. This role will focus on AI inference at scale, ensuring that customers and partners understand how to… more
- Red Hat (Raleigh, NC)
- …this role, your primary responsibility will be to build and release the Red Hat AI Inference runtimes, continuously improve the processes and tooling used by the ... open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise...on Github. We are seeking an experienced ML Ops engineer to work closely with our product and research… more
- Amazon (Cupertino, CA)
- …of applied scientists, system engineers, and product managers to deliver state-of-the-art inference capabilities for Generative AI applications. Your work will ... ML frameworks like PyTorch and JAX enabling unparalleled ML inference and training performance. The Inference Enablement...expertise to push the boundaries of what's possible in AI acceleration. As part of the broader Neuron organization,… more
- Amazon (Seattle, WA)
- …of applied scientists, system engineers, and product managers to deliver state-of-the-art inference capabilities for Generative AI applications. Your work will ... ML frameworks like PyTorch and JAX enabling unparalleled ML inference and training performance. The Inference Enablement...expertise to push the boundaries of what's possible in AI acceleration. As part of the broader Neuron organization,… more
- Amazon (Cupertino, CA)
- …learning accelerators and servers that use them. This role is for a software engineer in the Machine Learning Inference Model Enablement team for AWS Neuron ... beyond, as well as stable diffusion, vision transformers and many more. The Inference Model Enablement team works side by side with compiler engineers and runtime… more
- MongoDB (Palo Alto, CA)
- **About the Role** We're looking for a Senior Engineer to help build the next-generation inference platform that supports embedding models used for semantic ... with Atlas and designed for developer-first experiences. As a Senior Engineer , you'll focus on building core...supporting semantic search and hybrid retrieval + Collaborate with AI engineers and researchers to productionize inference … more
- NVIDIA (Santa Clara, CA)
- …streamlined deployment strategies with open-sourced inference frameworks. Seeking a Senior Deep Learning Algorithms Engineer to improve innovative generative ... to strengthen NVIDIA platform integration and expand market adoption across the AI inference ecosystem. What we need to see: + Master's, PhD, or equivalent… more
- NVIDIA (Santa Clara, CA)
- …teams alike developing best-in-class AI models. We are now looking for a Senior Deep Learning Software Engineer to develop and scale up our automated ... NVIDIA is at the forefront of the generative AI revolution! The Algorithmic Model Optimization Team specifically focuses on optimizing generative AI models such… more
- NVIDIA (Santa Clara, CA)
- We are now looking for a Senior DL Algorithms Engineer ! NVIDIA is seeking senior engineers who are mindful of performance analysis and optimization to help ... roadmap in a fast-growing technology company that leads the AI revolution. What you will be doing: + Implement...will be doing: + Implement language and multimodal model inference as part of NVIDIA Inference Microservices… more
- NVIDIA (Santa Clara, CA)
- NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, and ... optimize the GPU-accelerated software that powers today's most sophisticated AI applications. Our team is responsible for developing and maintaining high-performance… more
- NVIDIA (Santa Clara, CA)
- NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, and ... optimize the GPU-accelerated software that powers today's most sophisticated AI applications. Our team is responsible for developing and maintaining high-performance… more
- Amazon (Seattle, WA)
- …cloud-scale machine learning accelerators. This role is for a senior software engineer in the Machine Learning Inference Applications team. This role is ... for development and performance optimization of core building blocks of LLM Inference - Attention, MLP, Quantization, Speculative Decoding, Mixture of Experts, etc.… more
- Amazon (Seattle, WA)
- …cloud-scale machine learning accelerators. This role is for a senior software engineer in the Machine Learning Inference Applications team. This role is ... for development and performance optimization of core building blocks of LLM Inference - Attention, MLP, Quantization, Speculative Decoding, Mixture of Experts, etc.… more
- NVIDIA (CA)
- We are now looking for a Senior System Software Engineer to work on Dynamo & Triton Inference Server! NVIDIA is hiring software engineers for its ... out from the crowd: + Prior work experience improving performance of AI inference systems. + Background with deep learning algorithms and frameworks. Especially… more
- NVIDIA (Santa Clara, CA)
- …to work on cutting-edge AI technology? Join NVIDIA's TensorRT team as a Senior Software Engineer , and be at the forefront of technology, enabling support in ... ready to tackle challenging projects, push the boundaries of AI , and make a significant impact in a company...models (such as Large Language Models) & frameworks for inference . + Background with C++17. NVIDIA is widely considered… more
- NVIDIA (Durham, NC)
- … Senior Deep Learning Inference Performance Architect! NVIDIA is seeking a Senior Performance Architect - a creative engineer who loves to squeeze out ... team does groundbreaking hardware-software co-design work that focuses on accelerating AI Inference workloads. In this role, you will write performance optimized… more