The AI Engineer will establish Firmus AI Factory as the foundation for efficient, production‑grade distributed training by delivering pre‑built training recipes (TorchTitan, Megatron, etc.), evaluation benchmarks, and model guidance. You’ll work with customers and internal teams to optimize training efficiency, define baselines, and document best practices. Your templates and benchmarks are the anchor point for our hyperscale customers’ training workflows and our model arena differentiator.
Key Responsibilities
Build production‑ready training recipes using TorchTitan and Megatron‑LM: model configs, parallelism strategies (FSDP, tensor/pipeline parallelism), checkpointing patterns.
Document parameter tuning for different scales (e.g., “to train Llama 7B on 8xH100s, use this config and expect X throughput”).
Create and validate multi‑node NCCL communication patterns on AI Factory K8s/Slurm clusters.
Design and build benchmarking suites: accuracy, latency, throughput (token...