LLM Engineer Jobs in New York

Harvey is transforming legal and professional services by combining advanced agentic AI, an enterprise platform, and deep domain expertise. This role offers a unique opportunity to contribute to a rapidly scaling company at a pivotal moment, defining a new category in real-time. The team operates with intensity, ownership, and a commitment to excellence, driven by values of decisiveness, simplicity, and continuous improvement. If you are motivated to do your best work alongside driven individuals, Harvey is the place to build the future of professional services.

$230k - $340k

Anthropic

As a senior data science leader for Model Experience, you will play an instrumental role in shaping data-informed decision-making across the organization. You will be a strategic thought partner to product, engineering, and research leaders, influencing model roadmap and launch decisions by providing insights into user experience and model performance beyond benchmark scores. In this tech lead manager role, you will also be responsible for hiring, managing, and developing a team of data scientists, setting their agenda, leading high-stakes analyses, and elevating the impact of data on model and product decisions.

$380k - $460k

Scale AI

Our Generative AI Data Engine powers advanced LLMs and generative models through RLHF, human data generation, model evaluation, safety, and alignment. The data produced is crucial for how humanity will interact with AI. This horizontal, high-impact Staff Fullstack Engineer & Architect position reports directly to the Director of Contributor Engineering. Your scope spans across all Contributor (CB) teams, powering AI data operations from building high-impact datasets to optimizing contributor onboarding and incentives, and safeguarding data integrity. You will act as an organizational architect and tech lead, embedding into high-priority projects to guarantee execution, unblock teams, and ship mission-critical initiatives. Concurrently, you will lead the long-term technical evolution of our stack, transforming the core architecture to ensure it is highly sustainable, scalable, and fundamentally AI-native.

$252k - $315k

Cursor

SpaceXAI is building Super Intelligence to help humanity understand the universe, from supercomputers to large language models and user-facing applications. As a Software Engineer on the Model Lifecycle and Signals team, you will be responsible for integrating frontier models into user-facing products at a massive scale. This role involves deciding which models to use, monitoring their performance, and providing feedback to shape future model development. You will work at the intersection of infrastructure, data, and product, bringing models from preview to production, analyzing real-world data, and collaborating with research, inference, product, and data science teams to improve both products and models. Your contributions will have a compounding impact across all products and shipped models.

Salary not listed