New: upload your resume and get matched to AI jobs. Free to start →

Senior Data Platform Engineer

$165k - $200k • Remote • Remote, USA • Full-time

Posted 1mo ago

Job Location

Remote, USA

Tech Stack

Remote Work Policy

Fully remote

Employment Type

Full-time

Visa Sponsorship

The posting says they won't sponsor visas

Categories

Machine Learning Engineer

About the job

DEFCON AI is seeking a Senior Data Platform Engineer to own the durable view of every resolved entity on the platform. This role involves building and maintaining the storage layer that preserves source disagreement and history, ensuring that all facts, their origins, confidence levels, and changes over time are retained. You will be part of an analytics and AI engineering team working on a system that ingests data from diverse sources, resolves entities, and provides transparent, explainable recommendations. The platform operates in a secure government cloud environment and requires a storage layer that meticulously preserves all information, even conflicting data, to answer historical questions about beliefs and evidence.

Responsibilities

  • Design and build the storage layer to preserve source disagreement and history.
  • Develop the result and evidence store for the first release, retaining per-person results, originating records, prior results, human feedback, and configuration versions.
  • Implement provenance and lineage tracking across the platform's evidence-record contract.
  • Store the versioned rule library and configuration, recording exact rule versions and context for model-assisted steps.
  • Ensure all writes are traceable to their origin and all decisions are reproducible.
  • Carry match confidence and other uncertainty forward through the platform.
  • Support point-in-time queries about beliefs and evidence for specific entities.
  • Collaborate with entity resolution and ML teams to define storage layer requirements.

Requirements

  • 6+ years in data engineering or data platform engineering.
  • Production experience with versioned, temporal, or historized data models.
  • Experience designing storage that prioritizes history, provenance, and source disagreement.
  • Comfort working with probabilistic upstream output rather than clean shared keys.
  • Strong Python and SQL skills with production experience on PostgreSQL or similar.
  • US Citizenship required.
  • Active US Secret clearance.

Benefits

  • Competitive salary, bonus, and equity package.
  • 100% employer-paid health insurance (medical, dental, vision) for employee and family.
  • Unlimited PTO with manager approval.
  • Flexible work environment.
  • 14 weeks of fully-paid parental leave.