Member of Technical Staff, Retrieval & Indexing
$150k - $300k • San Francisco or Palo Alto • FullTime
Posted 3mo ago
Job Location
San Francisco or Palo Alto
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
AI Engineer
About the job
Parallel is seeking a Member of Technical Staff focused on Retrieval & Indexing to build and operate the systems powering our large-scale full-text index over the web. This role involves the entire lifecycle, from deciding corpus content and building searchable structures to developing signals and models for source quality and freshness, and efficiently serving queries. You will proactively identify and address architectural bottlenecks to ensure our systems scale with increasing demand.
Responsibilities
- Build and operate systems for large-scale full-text indexing of the web.
- Determine corpus content and construct searchable data structures.
- Develop signals and models to assess source quality and freshness.
- Serve queries against the index with speed and cost-efficiency.
- Anticipate and resolve architectural bottlenecks to meet growing demand.
Requirements
- Deep intuition in information retrieval, distributed systems, and performance tuning.
- Ability to reason about trade-offs between classical and neural retrieval, and cost, reliability, and latency.
- Bachelor's degree or equivalent combination of education, training, and professional experience.
- Demonstrated experience in a field relevant to the role through coursework, training, or professional experience.
Benefits
- Competitive salary
- Generous equity
- Visa sponsorships
- 401K plans
- Daily lunch & office snacks
- Dinner at the office
- Unlimited vacation
- Caltrain pass reimbursement