ML Performance Engineer – High-Performance AI – NYC / 5 days in office – Basic up to $175,000 + Bonus and Benefits ($300,000 – $600,000 package)

Are you an expert in C++, deep learning frameworks, and performance optimization? Do you thrive on eliminating bottlenecks and scaling AI infrastructure? We’re seeking a Machine Learning Performance Engineer to work on a pivotal AI initiative in New York City. This is a 5-day in-office role, offering an amazing opportunity to optimize machine learning training, inference, and infrastructure at scale.

What you’ll do:

• Build scalable ML training & inference pipelines
• Optimize deep learning frameworks (PyTorch, JAX, TensorFlow) to enhance performance
• Identify & eliminate performance bottlenecks in AI systems
• Work with GPUs & accelerators (CUDA, Triton, Pallas) to push efficiency limits
• Collaborate closely with researchers & engineers to integrate performance improvements

What we’re looking for:

• Expert in deep learning framework internals (JAX, PyTorch, TensorFlow)
• Strong C++ & Python programming skills
• Deep understanding of computer architecture & performance engineering
• Experience with large-scale distributed training & AI model optimization
• Prior experience in big tech, Autonomous Vehicles (AV), and Hedge Fund/Quantitative Trading firms

Bonus points for:

• Experience with GPU acceleration (CUDA, Triton, Pallas, etc.)
• Linux system programming expertise
• Contributions to open-source AI projects

Why join?

• High-impact role in optimizing AI infrastructure
• Competitive salary + performance-based bonuses
• Global profit-sharing & 401(k) matching
• Extensive perks: Office meals, social events, clubs, and more

How do you apply?

If you are interested in applying for the Machine Learning Performance Engineer role, please do so via the link on this page or contact Digital Republic by phone or email.

Contact us to find out more:

Get in contact with Digital Republic Talent by sending an email to [email protected]. Check out the website at www.digitalrepublictalent.com. You can also find out more on Linkedin, Instagram or Facebook.