- Capital One Bank (Washington, DC)
- Senior AI Engineer (LLM...AI and ML algorithms or technologies (eg LLM Inference , Similarity Search and VectorDBs, Guardrails, Memory) using Python, ... agreed upon number of hours to be regularly worked.Cambridge, MA: $158,600 - $181,000 for Senior AI Engineer McLean, VA: $158,600 - $181,000 for Senior… more
- Capital One Bank (Newport News, VA)
- …and fine tuning Transformer architecture based models as well as generative AI inference applications. Your depth of experience in technologies including ... Senior Lead Software Engineer , Distributed Systems...One machine learning platform organization manages our cloud-based enterprise ML+ AI system providing users with development tools and runtime… more
- Bank of America (Addison, TX)
- Senior Engineer - AI Inference Addison, Texas;Charlotte, North Carolina; Kennesaw, Georgia; Newark, Delaware **To proceed with your application, you must ... must be at least 18 years of age.** Acknowledge (https://ghr.wd1.myworkdayjobs.com/Lateral-US/job/Addison/ Senior - Engineer - AI - Inference \_25029879) **Job Description:**… more
- NVIDIA (Santa Clara, CA)
- …software ecosystem to power AI at scale. We are looking for a Senior Technical Marketing Engineer to join our growing accelerated computing product team. ... ensure a consistent, high-impact go-to-market strategy. This role will focus on AI inference at scale, ensuring that customers and partners understand how to… more
- Red Hat (Boston, MA)
- …this role, your primary responsibility will be to build and release the Red Hat AI Inference runtimes, continuously improve the processes and tooling used by the ... open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise...LLM deployments. We are seeking an experienced ML Ops engineer to work closely with our product and research… more
- NVIDIA (WA)
- We are now looking for a Senior Research Engineer passionate about Generative AI inference . Are you excited to change the way people infuse AI into ... products and services? NVIDIA is at the forefront of generative AI models, from language to images. NVIDIA provides building blocks to democratize AI and make… more
- Amazon (Seattle, WA)
- …of applied scientists, system engineers, and product managers to deliver state-of-the-art inference capabilities for Generative AI applications. Your work will ... ML frameworks like PyTorch and JAX enabling unparalleled ML inference and training performance. The Inference Enablement...expertise to push the boundaries of what's possible in AI acceleration. As part of the broader Neuron organization,… more
- Amazon (Cupertino, CA)
- …learning accelerators and servers that use them. This role is for a software engineer in the Machine Learning Inference Model Enablement team for AWS Neuron ... beyond, as well as stable diffusion, vision transformers and many more. The Inference Model Enablement team works side by side with compiler engineers and runtime… more
- Google (Kirkland, WA)
- Staff Software Engineer , Generative AI Inference _corporate_fare_ Google _place_ Seattle, WA, USA; Kirkland, WA, USA **Advanced** Experience owning outcomes ... a Software Engineer , you will joining the Inference Workload team, responsible for Gen AI ...Inference projects, and guide/review the designs of other senior engineers for architectural robustness and scalability. + Uncover,… more
- MongoDB (Seattle, WA)
- …-powered applications. **About the Role** We're looking for a Senior Engineer to help build the next-generation inference platform that supports embedding ... with Atlas and designed for developer-first experiences. As a Senior Engineer , you'll focus on building core...supporting semantic search and hybrid retrieval + Collaborate with AI engineers and researchers to productionize inference … more
- NVIDIA (CA)
- …distributed model management systems, including Rust-based runtime components, for large-scale AI inference workloads. + Implement inference scheduling ... people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An...on the world. We are now looking for a Senior System Software Engineer to work on… more
- NVIDIA (Santa Clara, CA)
- …streamlined deployment strategies with open-sourced inference frameworks. Seeking a Senior Deep Learning Algorithms Engineer to improve innovative generative ... to strengthen NVIDIA platform integration and expand market adoption across the AI inference ecosystem. What we need to see: + Master's, PhD, or equivalent… more
- NVIDIA (Santa Clara, CA)
- …see how you can make a lasting impact on the world. We are seeking a Senior Software Engineer to join our Software Infrastructure Team in Santa Clara, CA. This ... and development of a scalable, robust, and reliable platform for serving AI models for inference as a service. + Develop and implement systems for dynamic GPU… more
- NVIDIA (Santa Clara, CA)
- …teams alike developing best-in-class AI models. We are now looking for a Senior Deep Learning Software Engineer to develop and scale up our automated ... NVIDIA is at the forefront of the generative AI revolution! The Algorithmic Model Optimization Team specifically focuses on optimizing generative AI models such… more
- NVIDIA (Santa Clara, CA)
- We are now looking for a Senior DL Algorithms Engineer ! NVIDIA is seeking senior engineers who are mindful of performance analysis and optimization to help ... roadmap in a fast-growing technology company that leads the AI revolution. What you will be doing: + Implement...will be doing: + Implement language and multimodal model inference as part of NVIDIA Inference Microservices… more
- NVIDIA (Santa Clara, CA)
- NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, and ... optimize the GPU-accelerated software that powers today's most sophisticated AI applications. Our team is responsible for developing and maintaining high-performance… more
- Amazon (Seattle, WA)
- …cloud-scale machine learning accelerators. This role is for a senior software engineer in the Machine Learning Inference Applications team. This role is ... for development and performance optimization of core building blocks of LLM Inference - Attention, MLP, Quantization, Speculative Decoding, Mixture of Experts, etc.… more
- Amazon (Seattle, WA)
- …cloud-scale machine learning accelerators. This role is for a senior software engineer in the Machine Learning Inference Applications team. This role is ... for development and performance optimization of core building blocks of LLM Inference - Attention, MLP, Quantization, Speculative Decoding, Mixture of Experts, etc.… more
- Amazon (Cupertino, CA)
- …and the Trn1 and Inf1 servers that use them. This role is for a software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. This role is ... compiler engineers and runtime engineers to create, build and tune distributed inference solutions with Trn1. Experience optimizing inference performance for… more
- NVIDIA (Santa Clara, CA)
- …team in developing the industry-leading deep learning inference software for NVIDIA AI accelerators. As a Senior Software Engineer in the TensorRT ... team, you will be responsible for designing and implementing inference software optimizations to power AI applications on NVIDIA GPUs. If you're ready to take on… more
