Skip to content

Microsoft Open Source Blog

Clear all
Your selected filters are:

Blog posts

Diagram

ONNX Runtime Web—running your machine learning model in browser 

  • Emma Ning
    By Emma Ning, Principal Program Manager, AI Frameworks
  • Yulong Wang
    Senior Software Engineer, AI Frameworks
  • Du Li
    Senior Software Engineer, AI Frameworks
We are introducing ONNX Runtime Web (ORT Web), a new feature in ONNX Runtime to enable JavaScript developers to run and deploy machine learning models in browsers. It also helps enable new classes of on-device computation. ORT Web will be replacing the soon to be deprecated onnx.js, with improvements such as a more consistent developer...Read more

Join Microsoft and the Spring community at SpringOne 2021 

Microsoft loves Spring, and we’d love to see you at SpringOne during September 1 – 2, 2021. Join us for Spring on Azure announcements and attend keynotes, sessions, and hands-on workshops over a two-day, all-virtual event. Spring is an important part of the Java ecosystem and we’ve been working together with VMware to make it...Read more

Introducing Distributed Data Parallel support on PyTorch Windows 

Model training has been and will be in the foreseeable future one of the most frustrating things machine learning developers face. It takes quite a long time and people can’t really do anything about it. If you have the luxury (especially at this moment of time) of having multiple GPUs, you are likely to find...Read more

Microsoft expands support with The Eclipse Foundation 

  • Image of Stephen Walli
    By Principal Program Manager, Azure Office of the CTO
At Microsoft, our goal is to empower all developers to be successful building any application, using any language, on any platform. To do so, we are committed to building open, flexible technology, and to working together with the open source community to grow together as an industry. Microsoft has worked with the Eclipse community for...Read more

Accelerate PyTorch training with torch-ort 

With a simple change to your PyTorch training script, you can now speed up training large language models with torch_ort.ORTModule, running on the target hardware of your choice. Training deep learning models requires ever-increasing compute and memory resources. Today we release torch_ort.ORTModule, to accelerate distributed training of PyTorch models, reducing the time and resources needed...Read more
ONNX Runtime and AMD logo side by side

ONNX Runtime release 1.8.1 previews support for accelerated training on AMD GPUs with the AMD ROCm™ Open Software Platform 

  • a man wearing glasses and smiling at the camera
    By Principal Software Engineer, AI Frameworks at Microsoft
  • a close up of a man who is smiling and looking at the camera
    Software Engineer, AI Frameworks at Microsoft
This post was co-authored by Jeff Daily, a Principal Member of Technical Staff, Deep Learning Software for AMD. ONNX Runtime is an open-source project that is designed to accelerate machine learning across a wide range of frameworks, operating systems, and hardware platforms. Today, we are excited to announce a preview version of ONNX Runtime in...Read more
diagram

Simple steps to create scalable processes to deploy ML models as microservices 

This post was co-authored by Alejandro Saucedo, Director of Machine Learning Engineering at Seldon Technologies. About the co-author: Alejandro leads teams of machine learning engineers focused on the scalability and extensibility of machine learning deployment and monitoring products with over five million installations. Alejandro is also the Chief Scientist at the Institute for Ethical AI...Read more

Journey to optimize large scale transformer model inference with ONNX Runtime 

  • a man standing in front of a body of water
    By Applied Scientist II, Data&AI, Developer Division (DevDiv)
  • a person posing for the camera
    Senior Researcher SDE, Turing Team
  • Emma Ning
    Emma Ning, Principal Program Manager, AI Frameworks
“With its resource-efficient and high-performance nature, ONNX Runtime helped us meet the need of deploying a large-scale multi-layer generative transformer model for code, a.k.a., GPT-C, to empower IntelliCode with the whole line of code completion suggestions in Visual Studio and Visual Studio Code.” Large-scale transformer models, such as GPT-2 and GPT-3, are among the most...Read more

How to migrate and modernize Linux workloads and open source databases to Azure 

With extensive support for all major Linux distributions including Red Hat, SUSE, Ubuntu, CentOS, Debian, and managed platform-as-a-service (PaaS) offerings for open source databases like Azure Database for MySQL, Azure Database for PostgreSQL, and Azure Database for MariaDB—it’s no surprise that Linux is the fastest growing platform on Azure. Furthermore, Azure Migrate makes the discovery,...Read more

Empowering you to achieve more with open source on Azure 

At Microsoft, we are taking cloud architecture to the next level and our open cloud reduces the friction for developers to get applications up and running. We give autonomy and control to the developers to flexibly choose their infrastructure and give them options to build, migrate, and deploy across multiple environments on-premises, in the cloud,...Read more

ONNX Runtime 1.8: mobile, web, and accelerated training 

  • Faith Xu bio pic
    By Senior Program Manager, Machine Learning Platform
The V1.8 release of ONNX Runtime includes many exciting new features. This release launches ONNX Runtime machine learning model inferencing acceleration for Android and iOS mobile ecosystems (previously in preview) and introduces ONNX Runtime Web. Additionally, the release also debuts official packages for accelerating model training workloads in PyTorch. ONNX Runtime is a cross-platform runtime...Read more