[Remote] Senior AI Graph Compiler Engineer
Note: The job is a remote job and is open to candidates in USA. Modular is a company focused on creating advanced machine learning technologies, and they are seeking a Senior AI Graph Compiler Engineer. This role involves extending and developing the graph compiler to enhance performance and usability across various hardware platforms, ensuring a seamless developer experience.
Responsibilities
- Design and develop compiler optimizations to improve inference efficiency across CPUs, GPUs, and ML accelerators, including kernel fusion, memory planning, and shape optimization
- Compile large-scale application workloads onto heterogeneous hardware: map hardware-agnostic graphs of computational operators onto hardware-specific graphs of devices and nodes
- Collaborate with the kernels, serving, and Mojo compiler teams to implement core technologies that deliver end-to-end performance across a variety of heterogeneous hardware platforms
- Write design documents for new features and drive for alignment on designs with cross-functional teams
- Collaborate with the customer success team and engage with customers to understand their performance requirements and use cases
Skills
- 5+ years of software engineering experience
- Proficiency in C++
- Experience working with compilers for machine learning frameworks
- Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others
- Knowledge of and experience working with MLIR and LLVM
- Experience with ML parallel / distributed programming, heterogeneous ML computation, and/or code generation
- Knowledge of basic ML implementation and modeling techniques and familiarity with ML frameworks like PyTorch, JAX, or TensorFlow
Benefits
- Premier insurance plans
- Up to 5% 401k matching
- Flexible paid time off
- Stock options
- Team Building Events. We organize regular team onsites and local meetups in Los Altos, CA as well as different cities. Traveling 2-4 times a year is expected for all roles.
Company Overview
Company H1B Sponsorship