Boosting performance in ONNX Runtime with Intel® AMX for 4th Gen Intel® Xeon® Processors
ONNX Runtime, Intel®, and Microsoft developed the 8-bit integer matrix multiplication kernel in ONNX Runtime using Intel® AMX instructions, resulting in four times faster performance than 3rd Gen Intel® Xeon® using Intel® DL Boost. Read more