Senior AI (Infrastructure) Engineer | Prop Trading Firm

About the role

Build and operate the model platform, including model routing, distillation and fine-tuning pipelines, self-hosted inference, and GPU infrastructure on Kubernetes. Develop evaluation and regression frameworks, establish criteria for choosing open or commercial models, and collaborate on platform standards and support for future agentic workloads. Candidates should have around 6–10 years of software, machine learning, or AI engineering experience, strong production Python skills, and a record of owning technically demanding systems. They need hands-on experience with open-weight model training or distillation, self-managed LLM serving, GPU-backed Kubernetes environments, and robust model evaluation; quantization, PEFT, LoRA, and model gateway experience are preferred.