- Menlo Ventures (San Francisco, CA)
- Anthropic, a public benefit corporation, is seeking a trust and safety software engineer to develop systems that ensure user well-being and prevent misuse of AI ... models. The role involves building monitoring systems, analyzing user reports, and collaborating with research teams to enhance model integrity. Candidates should have a Bachelor's degree in a related field and significant experience in software engineering.… more
- OpenAI (San Francisco, CA)
- …We are looking for a software engineer with anti fraud & abuse experience to help architect and build our next-generation anti-fraud systems. Responsibilities ... Design and build systems for fraud detection and remediation while balancing fraud loss, cost of...closely with finance, security, product, research, and trust & safety operations to holistically combat fraudulent and abusive actors… more
- OpenAI (San Francisco, CA)
- …human- AI -human interactions. In this role, you will own the analytical view of safety and abuse risks in AI ‑social environments: Sora content and ... strategic analysis and future‑looking perspectives Produce concise, decision‑ready briefs on AI ‑social risks for leadership, safety forums, and partner teams.… more
- vercel (San Francisco, CA)
- …growing companies. You have applied experience building and maintaining scaled abuse detection and restriction/checkpoint systems in a professional setting. ... personalized web. As the team behind v0, Next.js, and AI SDK, Vercel helps customers like Ramp, Supreme, PayPal,...what we do is keeping up with Trust & Safety issues. Whether it's building out detection … more
- Menlo Ventures (San Francisco, CA)
- …our customers. The team will use statistical and machine learning techniques for fraud and abuse detection on our platforms using state of the art methods. The ... world's best and most secure platform for data and AI . We innovate and deploy industry‑leading solutions in security,...work in fraud and abuse detection is dynamic and essential, offering… more
- King River Capital Group (San Francisco, CA)
- …most complex and high-impact challenges in safety , including adversarial abuse , harmful content detection , and evolving threat vectors. Develop cutting-edge ... state-of-the-art ML to detect and prevent harm while staying ahead of emerging abuse patterns. Influence the company's direction on safety , clearly communicating… more
- Menlo Ventures (San Francisco, CA)
- …candidates may also: Have experience building trust and safety mechanisms for AI /ML systems, such as fraud detection models or security monitoring tools or ... in internal dashboards to analysts for manual review Build abuse detection mechanisms and infrastructure Surface ...Laws, AI & Compute, Concrete Problems in AI Safety , and Learning from Human Preferences.… more
- OpenAI (San Francisco, CA)
- …enables our partner teams to develop data-backed product policies and build scaled safety mitigations. Precisely understanding abuse allows us to safely enable ... especially those that are not caught by our existing safety systems. This will require expert understanding of our...monitoring subtasks. Prototype and mature into production systems of detection , review, and enforcement of abuse for… more
- Icon Ventures (San Francisco, CA)
- …engagement Trust & Safety Systems: Build infrastructure to support abuse detection , content moderation, and policy enforcement Privacy and Consent ... Future of Learning Join us to design and deliver AI -powered learning tools that scale across the world and...identity, account management, user communication infrastructure, and trust & safety systems at Quizlet. This high-impact role will help… more
- Icon Ventures (San Francisco, CA)
- …like Braze Implement features that support moderation, privacy requests, and abuse detection Ensure regulatory compliance through thoughtful consent flows ... tools. Let's Build the Future of Learning Join us to design and deliver AI -powered learning tools that scale across the world and unlock human potential. About the… more
- Icon Ventures (San Francisco, CA)
- …systems like Braze. Implement features that support moderation, privacy requests, and abuse detection . Collaborate with teammates to ensure compliance through ... tools. Let's Build the Future of Learning Join us to design and deliver AI -powered learning tools that scale across the world and unlock human potential. About the… more
