[Remote] System Software Engineer - AI
Note: The job is a remote job and is open to candidates in USA. Delos-data is a stealth-mode startup focused on building foundational technology for large-scale AI data center clusters. They are seeking a talented System Software Engineer to design and implement communication and execution primitives for efficient AI model operations across thousands of GPUs.
Responsibilities
- Collaborate across the stack to influence the design of our foundational technology, ensuring it meets the needs of next-generation AI models
- Identify and resolve performance bottlenecks in distributed training and inference workloads through deep-dive analysis of the software-hardware interface
- Conduct rigorous performance benchmarking and characterization on multi-node clusters
Skills
- Strong proficiency in C++ and Python, with a deep understanding of systems programming fundamentals (memory management, concurrency, OS internals)
- Proficient in a Linux development environment
- Bachelor's or Master's degree in Computer Engineering, Computer Science, or a related field
- Experience with GPU programming (CUDA) and performance optimization for parallel architectures
- Familiarity with distributed AI frameworks (PyTorch, JAX, or DeepSpeed) and/or inference engines (vLLM, SGLang, Dynamo/TRT-LLM)
- Hands-on experience with large-scale cluster orchestration and telemetry tools
Benefits
- Meaningful equity
- Benefits
- 401k
Company Overview