Software Engineer, Data Foundations
$180k - $300k • Remote • Mountain View, CA
Posted 1d ago
About the job
Glean is seeking a Software Engineer to join its Data Foundations team. This team is responsible for the entire data ingestion and management layer that powers Glean's Search, AI Assistant, and Agent products. Your work will directly impact the quality, freshness, and trustworthiness of the knowledge that all Glean users interact with daily. You will be instrumental in building and scaling connectors to various SaaS and on-prem systems, handling complex data synchronization, and transforming raw enterprise content into structured representations optimized for search and LLM reasoning. This role offers the opportunity to contribute to advanced data source capabilities and expand AI product functionality through deep integrations.
Responsibilities
- Build and scale connectors to a wide variety of SaaS and on-prem systems (e.g., Google Workspace, Microsoft 365, Slack, Salesforce, Jira, ServiceNow, GitHub).
- Handle full syncs, low-latency incremental updates via webhooks/APIs, rate-limiting, and complex authentication flows.
- Build advanced capabilities in datasources like actions, live-fetch, and query language support.
- Transform raw, unstructured enterprise content into rich, structured, permission-aware representations optimized for search and LLM reasoning.
- Design document schemas and enrichment pipelines (entity extraction, access-graph propagation, redactions, etc.).
- Expand AI product capabilities through deep integrations for task automation, complex data-grounded queries, and enhancing the indexed corpus with live data.
- Own end-to-end correctness, freshness, and performance for petabyte-scale data flows.
- Solve problems in ordering, idempotency, exactly-once processing, backpressure, and retries across distributed queues, workers, and storage.