Software Engineer - Kernels
$160k - $275k • Mountain View (HQ) or Remote • Full-time
Posted 2d ago
Remote Work Policy
On-site
Employment Type
Full-time
Categories
Machine Learning Engineer
About the job
MatX is building the compute platform for AGI, developing vertically integrated full-stack solutions from silicon to systems. We focus on hardware and software to train and run the largest ML workloads for AGI, primarily using the Rust programming language. This role involves designing and optimizing kernels that interface directly with our hardware, working in partnership with ML Research and Hardware Engineering teams, and providing expertise on hardware architecture from a programmer's perspective to ensure seamless integration with the software stack.
Responsibilities
- Design and optimize kernels that interface directly with hardware.
- Collaborate with ML Research and Hardware Engineering teams.
- Provide expertise and guidance on hardware architecture from a programmer's perspective.
- Implement kernels for ML models such as Transformers (bonus).
- Implement distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, and tensor parallelism (bonus).
Requirements
- Bachelor of Computer Science or equivalent degree.
- 10+ years of software development experience.
- Experience optimizing software for specialized hardware (e.g., parallelism, SIMD, assembly, GPU/CUDA).
- Proficiency in at least one of assembly, C++, C, Zig, or Rust.
- Familiarity with how compilers work (bonus).
Benefits
- Equity
- 4 weeks PTO + 12 company holidays + up to 3 weeks remote work
- Company-subsidized Medical (Kaiser or Anthem) for employees & dependents
- Guardian Dental and Vision insurances for employee & dependents
- 100% company-paid life insurance (up to $300K)
- HSA and FSA offerings via Lively
- Roth or pre-tax 401K (or both) with a 5% company contribution
- Long-term disability and travel insurance
- $1500 per year Professional Development Budget
- Onsite team lunch & dinner Monday - Friday
- 100% paid daily commute
- $50/mo for chosen perk
- $35/mo for cellular
- $40/mo for wifi
- Up to $1000 for remote home setup
- 100% paid mental health benefit via SpringHealth and Guardian EAP
- Up to 12 weeks paid parental leave
- 10 weeks pregnancy disability leave
- Flexible return-to-work hours
- $6K Family Fund