Microsoft Open Source Blog

Clear all
Your selected filters are:

Blog posts

Improve BERT inference speed by combining the power of Optimum, OpenVINO™, ONNX Runtime, and Azure 

5 min read
  • a person posing for the camera
    By Senior Technical Program Manager, ONNX Runtime, AI Frameworks—Microsoft
  • a person smiling for the camera
    Cloud Software Development Engineer, OpenVINO™ AI Frameworks Architectures—Intel
  • Devang headshot
    Product Manager, OpenVINO™ AI Framework Integrations—Intel
  • a man smiling for the camera
    Product Manager, OpenVINO™ AI Workflows —Intel

Make large models smaller and faster with OpenVino Execution Provider, NNCF and ONNX Runtime leveraging Azure Machine Learning. Read more

Sharp focus close-up of Rubik‘s cube on white desk. Black keyboard, pink flower lei, and other blurred items visible in background.

Faster inference for PyTorch models with OpenVINO Integration with Torch-ORT 

4 min read
  • Sai headshot
    By AI Frameworks Engineer, OpenVINO™ AI Framework Integrations–Intel
  • Vishnudas headshot
    AI Frameworks Engineer, OpenVINO™ AI Framework Integrations–Intel
  • Devang headshot
    Product Manager, OpenVINO™ AI Framework Integrations—Intel
  • Natalie headshot
    Senior Program Manager, AI Frameworks, Microsoft

Many developers opt to use popular AI Frameworks like PyTorch, which simplifies the process of analyzing predictions, training models, leveraging data, and refining future results. Read more

Join Microsoft at KubeCon + CloudNativeCon Europe 2022 

3 min read

Welcome to KubeCon Europe 2022. While I am unfortunately stuck in rainy Seattle (coldest start to May in 20 years), I’m excited that many of our cloud-native Azure folks will be able to experience sunny Valencia. It’s especially exciting for KubeCon to be the first chance for parts of the Azure Kubernetes Service (AKS) team Read more

Optimizing and deploying transformer INT8 inference with ONNX Runtime-TensorRT on NVIDIA GPUs 

5 min read
  • Emma Ning
    By Emma Ning, Principal Program Manager, AI Frameworks

Mohit Ayani, Solutions Architect, NVIDIA Shang Zhang, Senior AI Developer Technology Engineer, NVIDIA Jay Rodge, Product Marketing Manager-AI, NVIDIA Transformer-based models have revolutionized the natural language processing (NLP) domain. Ever since its inception, transformer architecture has been integrated into models like Bidirectional Encoder Representations from Transformers (BERT) and Generative Pre-trained Transformer (GPT) for performing tasks Read more

Scaling-up PyTorch inference: Serving billions of daily NLP inferences with ONNX Runtime 

8 min read
  • Faith Xu bio pic
    By Principal Program Manager, Machine Learning Platform

Scale, performance, and efficient deployment of state-of-the-art Deep Learning models are ubiquitous challenges as applied machine learning grows across the industry. We’re happy to see that the ONNX Runtime Machine Learning model inferencing solution we’ve built and use in high-volume Microsoft products and services also resonates with our open source community, enabling new capabilities that Read more

Supporting efficient large model training on AMD Instinct™ GPUs with DeepSpeed 

6 min read

This post was co-authored by Jithun Nair and Aswin Mathews, members of technical staff at AMD. In recent years, large-scale deep learning models have demonstrated impressive capabilities, excelling at tasks across natural language processing, computer vision, and speech domains. Companies now use these models to power novel AI-driven user experiences across a whole spectrum of Read more