Microsoft Open Source Blog On-Device Training: Efficient training on the edge with ONNX Runtime
Introducing On-Device Training, a new capability in ONNX Runtime which enables training models on edge devices without the data ever leaving the device. Read more
Posts by Kshama Pawar, Senior Program Manager
GPT-2 fine-tuning with ONNX Runtime – a 34% speedup in training time
Model training is an important step when developing and deploying large scale Artificial Intelligence (AI) models. Training typically utilizes a large amount of compute resources to tune the model based on the input dataset. Transformer models, with millions and billions of parameters, are especially compute-intensive and training costs increase with model size and fine-tuning steps Read more