Research Scientist - NLP
$150k - $450k • Sunnyvale, CA • Full-time
Posted 1y ago
Job Location
Sunnyvale, CA
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Research Engineer
About the job
We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy. As part of our team, you’ll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub for high-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AI pioneers.
Responsibilities
- Lead research for improving LLM efficiency and capabilities, including novel architectures and pre-training.
- Design and implement NLP algorithms for model training and prediction using PyTorch or other frameworks, leveraging ML infrastructure.
- Integrate and improve LLM algorithms to work with other models, such as computer vision models.
- Identify and address gaps in existing technology, collaborating with stakeholders to expand efficient LLM technology.
- Collaborate with peers and stakeholders through design and code reviews to ensure best practices.
- Document research findings in design documents, technical reports, and publications.
- Represent MBZUAI at industry conferences, showcasing HPC and deep learning capabilities.
- Perform other duties as directed by the line manager.
Requirements
- Master's degree in Computer Science, a related technical field, or equivalent practical experience.
- PhD or equivalent research experience in Natural Language Processing preferred.
- Experience with state-of-the-art Generative AI techniques and models (e.g., LLMs, Multi-Modal, Large Vision Models).
- Experience with software development in Python or C++, including data structures and algorithms.
- Excellent problem-solving and troubleshooting skills.
- Effective communication and collaboration skills.
- Ability to navigate ambiguity.
- Experience leading research efforts and influencing other researchers preferred.
- Experience with LLM efficiency, modularity, or related topics preferred.
- Experience with ML infrastructure (deployment, evaluation, optimization, data processing, debugging) preferred.
- Experience with algorithm design and optimization in performance-constrained environments preferred.
- Experience in innovative research and publishing in relevant forums preferred.