- Exa (San Francisco, CA)
- …thousands of machines. This isn't your average startup :) As a Web Crawler engineer , you'd be responsible for crawling the entire web . Basically build ... AI application. We build massive-scale infrastructure to crawl the web , train state-of-the-art embedding models to index it, and...Desired Experience You have extensive experience building and scaling web crawlers, or would be excited to ramp up… more
- OpenAI (San Francisco, CA)
- Software Engineer , Data Acquisition | OpenAI...to support our model training operations. Our team manages web crawling and GPTBot services and works ... and Scaling teams. We are looking for a skilled Software Engineer to join our Data Acquisition...engineering projects in the area of data acquisition including web crawling , data ingestion, and search. Collaborate… more
- Exa (San Francisco, CA)
- …serve every AI application. We build massive‑scale infrastructure to crawl the web , train state‑of‑the‑art embedding models to index it, and develop super ... up tens of thousands of machines. As a Data Engineer , you'll architect and build the data infrastructure that...build the data infrastructure that powers everything we do-from crawling billions of pages to training our embedding models… more
- Exa (San Francisco, CA)
- …to serve every AI application. We build massive-scale infrastructure to crawl the web , train state-of-the-art embedding models to index it, and develop super high ... This isn't your average startup :) As a backend engineer , you'd play a critical role in our backend...10 billion pages in 1 month Build a state-of-the-art crawling system that works optimally for any website Build… more
- Linkup (San Francisco, CA)
- …Engineer at Niland, an audio search company (acquired by Spotify), then Staff Engineer at Spotify. 15y of software development experience. Boris Toledano - ... the role We're looking for a top-tier Senior Data Engineer to join our tech team and work hand-in-hand...Build and operate large-scale, high-throughput data pipelines powering AI‑ready web search Design and maintain distributed ETL / ELT… more
