Senior System Software Engineer - Local AI Automation
Salary not listed • India, Pune • Full-time
Posted 19d ago
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Infrastructure Engineer
About the job
The Local AI Automation team is seeking a Senior System Software Engineer passionate about building and maintaining robust system-level software and infrastructure for deploying, benchmarking, and qualifying high-quality AI applications and models. You will collaborate with a team of highly qualified engineers dedicated to creating top-tier infrastructure for Local AI automation. If you have a real passion for building reliable, scalable automation systems in the AI ecosystem, this could be an excellent opportunity.
Responsibilities
- Design, implement, and maintain system software and infrastructure for running AI workloads through various inference backends (e.g., Llama.cpp, Ollama, PyTorch, vLLM, WinML, TRT-RTX).
- Define system requirements for deploying AI applications, benchmarks, and models, and develop solutions to measure correctness, functionality, reliability, and performance.
- Develop infrastructure for downloading, managing, and synchronizing a local AI model repository.
- Analyze large datasets and system workload metrics, implement data processing infrastructure, and design visualizations.
- Collaborate with developers to implement system-level instrumentation, diagnostics, and debugging capabilities.
- Design, implement, and maintain infrastructure for automated build, integration, deployment, and qualification across inference frameworks and environments.
- Debug issues in existing frameworks, identify performance bottlenecks, and enhance system efficiency and scalability.
Requirements
- 5+ years of experience with a B.Tech or higher degree in Computer Science, Information Technology, Software Engineering, or a related field.
- Strong analytical, systems debugging, and problem-solving abilities.
- 5+ years of software development experience with strong programming skills in C/C++, C#, Java, or another systems programming language.
- Exposure to at least one scripting language such as Python.
- Experience with system APIs, multithreaded software, process and resource management, debugging, or performance analysis.
- Familiarity with databases and SQL, source control systems (e.g., Git, Perforce), and CI/CD infrastructure (e.g., Jenkins).
- Outstanding written and oral communication skills.
Benefits
- Competitive salaries
- Generous benefits package