Staff Software Engineer, Perception (R5421)

What You'll Do:

Model Development – Design, train, fine-tune, and maintain state-of-the-art vision, vision-language, and vision-language-action models that improve perception and decision-making for autonomous systems. 

Data Pipelines & Model Training – Build scalable data pipelines, supervised fine-tuning (SFT) workflows, and evaluation loops that continuously improve model performance on mission-relevant tasks. 

Model Deployment & Optimization – Deploy and optimize machine learning models for embedded hardware using technologies such as ONNX, TensorRT, and hardware-accelerated inference frameworks. 

Perception & Autonomy Applications – Apply modern machine learning techniques to solve challenging perception and autonomy problems across aerial and other autonomous systems operating in complex, real-world environments. 

Research-to-Production – Translate cutting-edge machine learning research into production-ready capabilities by balancing model performance, robustness, computational efficiency, and operational reliability. 

Cross-functional Collaboration – Partner closely with perception, autonomy, platform, and software engineering teams to integrate machine learning capabilities into mission-ready autonomous systems. 

Model Evaluation & Validation – Develop benchmarks, testing methodologies, and evaluation frameworks to measure model performance, identify failure modes, and guide future improvements. 

Continuous Improvement – Improve training infrastructure, developer tooling, deployment workflows, and model lifecycle management to accelerate experimentation and production delivery. 

Required Qualifications:

• Typically requires a minimum of 7 years of related experience with a Bachelor’s degree; or 6 years and a Master’s degree; or 4 years with a PhD; or equivalent work experience.

• Expertise of machine learning fundamentals. 

• Experience training an deploying ML models for computer vision in a production setting. 

• Strong understanding of 3D vision problems/algorithms. 

• Experience with machine learning frameworks such as PyTorch and TensorFlow. 

• Demonstrated expertise in deploying models using TensorRT and ONNX. 

• Proficiency in C++ and Python. 

• Strong analytical and problem-solving skills, with the ability to translate research into practical applications. 

• Ability to obtain a SECRET clearance 

Preferred Qualifications:

• Experience with developing autonomous systems for defense customers. 

• Experience with training/finetuning vision-language models, vision-language-action models, and/or world models.  

• Contributions to open-source projects in machine learning or computer vision. 

• Track record of publications in leading computer vision and robotics conferences and journals (e.g., CVPR, ICCV/ECCV, RAL, ICRA).