Position Overview
We are looking for a highly motivated Software Engineer to join the LLMBoost team at MangoBoost. LLMBoost is our enterprise-grade platform for large language model deployment and optimization, supporting inference, training, fine-tuning, and retrieval-augmented generation across both AMD and NVIDIA GPUs. You will work alongside a team of experts to build, optimize, and scale AI workloads for high-performance, multi-node environments.
Responsibilities & Opportunities
- Develop, optimize, and test features for the LLMBoost platform, including model deployment, auto-tuning, and multi-GPU orchestration
- Contribute to performance benchmarking and optimization on both AMD and NVIDIA hardware
- Maintain infrastructure for automated builds, testing, and releases
- Collaborate with the team on debugging, profiling, and improving system reliability
Required Qualifications
- BS/MS/PhD in Computer Science, Electrical Engineering, or a related field (or equivalent experience)
- Proficiency in Python and Linux-based development environments
- Strong problem-solving skills and eagerness to work on large-scale AI systems
Nice to have if you...
- Can squeeze extra performance out of GPUs through kernel tuning and advanced profiling techniques
- Have published research or developed innovations in inference optimization, training acceleration, or distributed AI systems
- Know your way around Kubernetes and Docker for managing large-scale, containerized AI workloads
- Have hands-on experience running multi-node GPU training and inference jobs
- Understand the ins and outs of MLPerf or other AI benchmarking suites
- Can spot and fix network or I/O bottlenecks in high-throughput AI pipelines
- Have contributed to open-source AI/ML frameworks and love improving the tools the community relies on
With highly competitive salaries and a comprehensive benefits package, MangoBoost is an up and coming startup that is widely considered to be one of the technology world’s most desirable employers. We have some of the most brilliant and talented people in the world working for us. If you're creative and independent, with a genuine passion for technology, we want to hear from you.
Position Overview
We are looking for a highly motivated Software Engineer to join the LLMBoost team at MangoBoost. LLMBoost is our enterprise-grade platform for large language model deployment and optimization, supporting inference, training, fine-tuning, and retrieval-augmented generation across both AMD and NVIDIA GPUs. You will work alongside a team of experts to build, optimize, and scale AI workloads for high-performance, multi-node environments.
Responsibilities & Opportunities
- Develop, optimize, and test features for the LLMBoost platform, including model deployment, auto-tuning, and multi-GPU orchestration
- Contribute to performance benchmarking and optimization on both AMD and NVIDIA hardware
- Maintain infrastructure for automated builds, testing, and releases
- Collaborate with the team on debugging, profiling, and improving system reliability
Required Qualifications
- BS/MS/PhD in Computer Science, Electrical Engineering, or a related field (or equivalent experience)
- Proficiency in Python and Linux-based development environments
- Strong problem-solving skills and eagerness to work on large-scale AI systems
Nice to have if you...
- Can squeeze extra performance out of GPUs through kernel tuning and advanced profiling techniques
- Have published research or developed innovations in inference optimization, training acceleration, or distributed AI systems
- Know your way around Kubernetes and Docker for managing large-scale, containerized AI workloads
- Have hands-on experience running multi-node GPU training and inference jobs
- Understand the ins and outs of MLPerf or other AI benchmarking suites
- Can spot and fix network or I/O bottlenecks in high-throughput AI pipelines
- Have contributed to open-source AI/ML frameworks and love improving the tools the community relies on
With highly competitive salaries and a comprehensive benefits package, MangoBoost is an up and coming startup that is widely considered to be one of the technology world’s most desirable employers. We have some of the most brilliant and talented people in the world working for us. If you're creative and independent, with a genuine passion for technology, we want to hear from you.