On-Device Training with ONNX Runtime: A deep dive 

6 min read

Building upon the foundation we established earlier, this blog will present comprehensive information about the underlying details of training models directly on user devices using ORT. Equipped with these technical details, we encourage you to try out On-Device Training with ONNX Runtime for your custom scenario.  Read more

Supporting efficient large model training on AMD Instinct™ GPUs with DeepSpeed 

6 min read

This post was co-authored by Jithun Nair and Aswin Mathews, members of technical staff at AMD. In recent years, large-scale deep learning models have demonstrated impressive capabilities, excelling at tasks across natural language processing, computer vision, and speech domains. Companies now use these models to power novel AI-driven user experiences across a whole spectrum of Read more

Accelerate PyTorch training with torch-ort 

3 min read

With a simple change to your PyTorch training script, you can now speed up training large language models with torch_ort.ORTModule, running on the target hardware of your choice. Training deep learning models requires ever-increasing compute and memory resources. Today we release torch_ort.ORTModule, to accelerate distributed training of PyTorch models, reducing the time and resources needed Read more

Journey to optimize large scale transformer model inference with ONNX Runtime 

7 min read

“With its resource-efficient and high-performance nature, ONNX Runtime helped us meet the need of deploying a large-scale multi-layer generative transformer model for code, a.k.a., GPT-C, to empower IntelliCode with the whole line of code completion suggestions in Visual Studio and Visual Studio Code.” Large-scale transformer models, such as GPT-2 and GPT-3, are among the most Read more

Celebrating OSCON’s 20th anniversary 

5 min read

We’re in Portland this week for OSCON’s return to the City of Roses (or Beervana, depending on who you ask) to celebrate the ground-breaking event’s 20th birthday. Some of Microsoft’s 3,000 open source contributors from across the company will be there showcasing some of their favorite open source technologies and community projects throughout many breakout Read more

Microsoft at SCaLE 16x 

2 min read

The team is proud to support the sixteenth annual Southern California Linux Expo (SCaLE 16x) at the Pasadena Convention Center, California this week. The community-run, free and open source software event is the largest of its kind in North America. If you’re attending the show, catch up with us in Booth 513 where you can Read more

2 Comments

Now on GitHub: The Autonomous Driving Cookbook from Microsoft 

4 min read

At Microsoft, our mission is to empower every person and organization on the planet to achieve more. That’s why I’m happy to present the Autonomous Driving Cookbook which is now available on GitHub. The Autonomous Driving Cookbook is an open source collection of scenarios, tutorials, and demos to help you quickly onboard various aspects of Read more