Are you passionate about cloud computing? Are you excited about transforming Microsoft’s most critical business through automation, data and intelligence? If so, come help us build the most reliable, efficient, and futuristic datacenter infrastructure on the planet.

Microsoft’s Cloud Operations and Innovation (CO+I) team builds and operates Microsoft datacenters, which in turn power Microsoft’s cloud business.  We anticipate and provide capacity for continuous scale, enabling ~30% of Microsoft revenue through Commercial Cloud ($38 billion in FY20 Q1).  The CO+I Engineering team (CO+IE) delivers services, applications, and automation supporting datacenter planning, construction, and operation.  We own a large portfolio of services, including workflows that enable predicable, lowest cost datacenter construction, telemetry systems that drive high availability and optimized energy usage, and task and performance management applications that help our operation run as efficiently as possible.  CO+I Engineering is a competitive advantage for Microsoft, and an important pillar in its cloud success.

The Security Shared Technology Services (STSS) team in CO+I Engineering focuses on Microsoft datacenters’ Shared Technology Services, such as Business Intelligence Services, Collaboration Services, Cyber Defense and Critical Infrastructure Services.    We are looking for an experienced data engineer to drive development and maintenance of data infrastructure for various dataset and telemetry generated by different sources.   An ideal candidate will have a combination of strong data engineering, systems and cloud administration skills in Microsoft Data Platform and Azure Cloud environment, have good experience with running data quality improvements and data monitoring programs in highly distributed and collaborative data landscape, being able to communicate the status of their work at all levels, own your projects and systems end-to-end, be proactive and self-driven.   In addition to that, the candidate also needs to be familiar with Cyber Security data domain, creating algorithms and methodologies to synthesize intelligence and business value from various information sources.

You will be working with a team of world class engineers to build cloud services on Azure. You will also have the opportunity to explore and innovate using cutting edge technologies and advanced open-source frameworks. This is a unique, high impact opportunity with direct influence into the Microsoft’s cloud foundation. Come join us.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Responsibilities

Designing, constructing, testing, and maintaining a robust, reliable, and scalable security data pipeline infrastructure.

Assemble large, complex data sets that meet functional / non-functional business requirements

Identify, design, and implement internal process improvements, automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability

Build the infrastructure required for optimal extraction, transformation and loading data from wide variety of data sources using Azure technologies

Developing set processes for data mining, data modeling, and data production.

Design data visualization utilizing tools like Power BI and partner with business to create, prepare and distribute accurate reports to business unit as needed/requested

Design and administer data platforms and data models for supporting analytical services in Azure cloud environment.

Define and manage SLA for all data sets in allocated areas of ownership.

Build well-tested, up to date and documented datasets to provide actionable insights for key business metrics

Partnering with the multiple engineering teams on internal and customer facing security and privacy initiatives, ensuring that security data accessibility, quality, and reliability are considered.

Employing an array of technological tools to integrate with 3rd-party data systems.

Developing set processes for data mining, data modeling, and data production.

Evaluating external tooling, developing new automation, and tooling.

Run data quality and data monitoring improvement programs.

Manage performance, capacity, availability, security and compliance of data platform and data solutions.

Provide regular updates to stakeholders.

Qualifications

5+ years of experience with Microsoft SQL Server and Azure SQL Databases or similar database platforms. Fluent and fast with T-SQL, query analysis and optimization. Deep skills in modeling transactional databases and data warehouses.

3+ years of experience in administering Azure-based data infrastructures, including Windows systems administration (VMs or physical machines), storage, networking, security access, certificate, and compliance management.

3+ years of experience with ETL/ELT environments with Azure Data Factory, SSIS or similar technologies

3+ years of working on backend infrastructure/data systems or with application/infrastructure logging pipelines

Strong knowledge of Microsoft SQL Server Analysis Services and Azure Analysis Services (tabular).

Strong experience with Kusto (Azure Data Explorer).

Strong knowledge with Visualization tools, such as Power BI

Experience writing code, designing systems and data workflows, optimizing data processing algorithms, and systems to support wide variety of analytic workstream

Experience with CI/CD for Data Platform services, and integration with Azure DevOps

Strong communicator with both words and data - you understand what it takes to go from raw data to something a human understands.

Comfortable with complexity in the short term but can build towards simplicity in the long term.

Great collaboration skills

Preferred Qualifications:  

1+ years of experience using one of the popular programming languages (C#, Phyton, R, etc).

Familiarity with modern infrastructure technologies such as: Docker, Kubernetes, Terraform, Cloud Formation, Kinesis, Event Hub, Sentinel

Proven ability to drive strategic development and operations of data infrastructure and communicate their status.

Technical leadership skills (you enjoy being a tech lead, mentoring technologists, evangelizing security and privacy)

Microsoft Azure and/or Microsoft Data Platform official certifications is a plus

Contributions to the security community via talks, papers, blogs, projects, CVEs, etc.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.  We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

#COICareers

#COIEngCareers

#COISecCareers

#COIDataEngineer

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.