The Gen AI Infrastructure and Solutions team is building large-scale GenAI training infrastructure, LLM-based solutions and tools. We provide the infrastructure for teams in CoreAI and other Microsoft Groups to fine-tune LLMs for their own scenarios. We also build services and solutions of SLMs and LLMs for 1P\&3P on Azure, like Azure Machine Translation service.
As a Senior Software Development Engineer - Gen AI Infrastructure and Solutions, you will work on the infrastructure and tools to support large scale model fine-tuning, and evaluation. You will also work on the service to host SLMs/LLMs for translation to process trillions of characters per month.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.Responsibilities
As a team member of our team, you will participate in developing innovative solutions across AI Platform. Responsibilities include the following.
Collaborate with senior engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models.
Design and implement new AI features for Azure Machine translation and Language services.
Design, build and improve the services with high scalability and reliability.
Contribute to the deployment and monitoring of services in production environments.
participate in the efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments.
Qualifications
Required/minimum qualifications* Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
3+ years designing, developing, and shipping software.
2+ years of experience with distributed systems and cloud-based infrastructure.
1+ year of experience with DevOps practices (CI/CD, automated testing, deployment, etc.).
Other Qualifications* Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Additional or preferred qualifications* Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
-
OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
-
OR equivalent experience.
1+ year of experience with containerization tools (e.g., Docker, Kubernetes).
Familiarity with production ML systems and concepts like model serving, caching, batching, and monitoring.
Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Microsoft posts positions for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
#COREAI
#AIPLATFORM
Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.