Microsoft Open Source Blog Performant on-device inferencing with ONNX Runtime
The team at Pieces shares the problems and solutions evaluated for their on-device model serving stack and how ONNX Runtime enables their success. Read more
Technology
Improve BERT inference speed by combining the power of Optimum, OpenVINO™, ONNX Runtime, and Azure
Make large models smaller and faster with OpenVino Execution Provider, NNCF and ONNX Runtime leveraging Azure Machine Learning. Read more
Towards debuggability and secure deployments of eBPF programs on Windows
eBPF for Windows native code generation is a new mode of execution that maintains the integrity of the kernel and provides the safety promises of eBPF. Read more
Making culture count for Open Source sustainability—Celebrating FOSS Fund 25
To celebrate FOSS Fund #25 we have invited all employees whose projects were not selected in past FOSS Fund to propose a project for a one-time $500.00 USD award. We expect this to result in over 50 projects receiving this microgrant for a total of $25,000 USD. Read more
Hugging Face Transformers now enabled in Apache OpenNLP by ONNX Runtime
We’re excited to share the recent integration of ONNX Runtime in Apache OpenNLP! Apache OpenNLP is a Java machine learning library for natural language processing (NLP) tasks. Read more
Feathr feature store joins LF AI & Data Foundation
Together with our colleagues at LinkedIn, we are happy to announce that Feathr is joining the LF AI Data Foundation, an umbrella foundation of the Linux Foundation supporting open source innovation in AI and data. Read more
Supporting efficient large model training on AMD Instinct™ GPUs with DeepSpeed
This post was co-authored by Jithun Nair and Aswin Mathews, members of technical staff at AMD. In recent years, large-scale deep learning models have demonstrated impressive capabilities, excelling at tasks across natural language processing, computer vision, and speech domains. Companies now use these models to power novel AI-driven user experiences across a whole spectrum of Read more
Join us at the Build in the Open Happy Hour to connect and collaborate with Open Source enthusiasts
Open source has forever changed software development for the better. It has allowed developers from around the world to connect, collaborate, and build tomorrow’s technology. Microsoft culturally adopted an open mindset under Satya Nadella and internally changed the way software was developed. Microsoft is continually learning how to be a better open-source partner and support Read more
Announcing Azure Active Directory (Azure AD) workload identity for Kubernetes
Today, we are excited to announce an open-source project called Azure AD workload identity for Kubernetes. It leverages the public preview capability of Azure AD workload identity federation. With this project, developers can use native Kubernetes concepts of service accounts and federation to access Azure AD protected resources, such as Azure and Microsoft Graph, without needing Read more
Microsoft’s OSPO year in review—what we’ve learned
“Tech companies born with an open source mentality get it. It’s our ability to work together that makes our dreams believable and, ultimately, achievable. We must learn to build on the ideas of others”—Satya Nadella Whenever I teach open source at Microsoft, I open with this quote from Satya. Whether new to Microsoft, or learning Read more
Add AI to mobile applications with Xamarin and ONNX Runtime
ONNX Runtime now supports building mobile applications in C# with Xamarin. Support for Android and iOS is included in the ONNX Runtime release 1.10 NuGet package. This enables C# developers to build AI applications for Android and iOS to execute ONNX models on mobile devices with ONNX Runtime. ONNX Runtime is the open source project Read more
Progress on making eBPF work on Windows
eBPF is a well-known, but revolutionary, technology for providing programmability, extensibility, and agility. eBPF has been applied to use cases such as denial-of-service protection and observability. In May 2021, we announced the effort to make eBPF work on Windows, and were encouraged by the huge amount of interest. Six months have passed since then, and Read more