Do you want to work on building a planet-scale artificial intelligence (AI) system? The Azure Singularity team is looking for software engineers

to be part of a specialized startup team to build the next generation of cloud-based AI systems. Our work encompasses a wide array of hardware, compilers, distributed systems, operating systems, networking, and datacenter technologies.

What Is Singularity?

Singularity is a globally distributed, multi-tenant service that provides robust, cost-effective and competitive AI infrastructure (compute, networking and storage) for AI training and inferencing. Singularity provides unified service abstraction across heterogeneous specialized hardware (for e.g., Nvidia and AMD GPUs, FPGA etc.), compute topologies (for e.g., server-based and disaggregated compute topologies), backend networks (for e.g., Infiniband, LTL etc.) and container virtualization technologies for multi-tenancy.

In Singularity, we are constantly seeking to apply the best ideas from AI, ML, distributed systems, storage, networking, and security.

What You Will Work On?

In this role you will be responsible for building components to natively run online and batch AI inference workloads on the underlying infrastructure. This includes (but not limited to) ability to run distributed AI models exploiting pipeline and model parallelism for inference, stateless/stateful routing of inference requests and autoscaling inference endpoint.

Responsibilities

Responsibilities:

1. Design and build scalable, high-performance services that are highly reliable.
2. Manage multiple technical projects, ensure schedules, milestones, and priorities are compatible with technology and business goals.
3. Provide design reviews for other engineers, including feedback on architecture and design, integration, performance, and scalability.
4. Debug, triage and support production deployment of the service.

Qualifications

Required Qualifications:

• 7+ years of industry experience designing, developing and shipping high quality scalable software and services.
• 5+ years of industry experience with writing production quality code in one of C, C++ and C#, Java.
• BS or higher in Computer Science or related discipline (or equivalent experience)

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check. This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter. 

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.  We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.