ONNX Runtime 1.8: mobile, web, and accelerated training 

2 min read

The V1.8 release of ONNX Runtime includes many exciting new features. This release launches ONNX Runtime machine learning model inferencing acceleration for Android and iOS mobile ecosystems (previously in preview) and introduces ONNX Runtime Web. Additionally, the release also debuts official packages for accelerating model training workloads in PyTorch. ONNX Runtime is a cross-platform runtime Read more

Delivering reliable production experiences with PyTorch Enterprise on Microsoft Azure 

3 min read

At Microsoft, we use PyTorch to power products such as Bing and Azure Cognitive Services and we actively contribute to several PyTorch open-source projects, including PyTorch Profiler, ONNX Runtime, DeepSpeed, and more. Today, we’re announcing a new initiative in collaboration with Facebook—the PyTorch Enterprise Support Program. This new program enables service providers to develop and Read more

Making eBPF work on Windows 

3 min read

eBPF is a well-known but revolutionary technology—providing programmability, extensibility, and agility. eBPF has been applied to use cases such as denial-of-service protection and observability. Over time, a significant ecosystem of tools, products, and experience has been built up around eBPF. Although support for eBPF was first implemented in the Linux kernel, there has been increasing Read more

Optimizing BERT model for Intel CPU Cores using ONNX runtime default execution provider 

5 min read

This blog was co-authored with Manash Goswami, Principal Program Manager, Machine Learning Platform. The performance improvements provided by ONNX Runtime powered by Intel® Deep Learning Boost: Vector Neural Network Instructions (Intel® DL Boost: VNNI) greatly improves performance of machine learning model execution for developers. In the past, machine learning models mostly relied on 32-bit floating Read more

Microsoft Open Source success story—Babylon 

2 min read

An ongoing series of stories about Microsoft people and projects making their world better through open source. If you haven’t heard of Babylon.js, there is no doubt that it’s already made your day more cheerful, powering Microsoft Teams’ Reactions‘ (those cute floating emojis), or your presentation faster and smoother as the engine that powers rendering Read more

Create privacy-preserving synthetic data for machine learning with SmartNoise 

5 min read

Watch our webinar on Open Data Science Conference  Read the white paper on SmartNoise Differential Privacy machine learning case studies The COVID-19 pandemic demonstrates the tremendous importance of sufficient and relevant data for research, causal analysis, government action, and medical progress. However, for understandable data protection considerations, individuals and decision-makers are often very reluctant to share personal or sensitive data. Read more

Enabling responsible AI development with new open source capabilities 

3 min read

At last year’s Microsoft Build conference in May 2020, Microsoft introduced three responsible AI (RAI) toolkits available in both open source as well as integrated within Azure Machine Learning: InterpretML, Fairlearn, and SmartNoise. These tools enable machine learning data scientists to understand model predictions, assess fairness, and protect sensitive data. Building on this family of Read more

The community effort that delivered Dapr v1.0 

3 min read

Today we’ve announced the release of Dapr v1.0. The Distributed Application Runtime (Dapr) is now available as a production ready solution that helps developers build resilient, portable event-driven distributed applications on the cloud and edge. It has been an incredible journey bringing Dapr from its initial release in October 2019 to production readiness and it Read more

Microsoft joins Rust Foundation 

1 min read

Today we’re excited to share that Microsoft is joining industry partners as founding members of the Rust Foundation, a new independent organization established to steward the Rust programming language and ecosystem and support Rust’s maintainers. We look forward to collaborating with the Rust community to continue improving the Rust language, providing tooling and library support, Read more