|
The Xentara ONNX Engine v2.0
User Manual
|
The Xentara ONNX engine allows you to run machine learning models inside Xentara. ONNX is an open format built to represent machine learning models. Models can be developed and trained using a variety of popular ML tools, and converted to the ONNX model format using a converter. A list of supported tools can be found here.
The Xentara ONNX engine uses the ONNX Runtime to run ONNX models. The ONNX runtime supports acceleration on a wide variety of hardware, including GPUs, NPUs, and FPGAs, using so called execution providers. A list of supported execution providers can be found here.
This documentation assumes you are familiar with ONNX and the ONNX Runtime. Information on ONNX can be found at https://onnx.ai/. Information about the ONNX runtime can be found at https://onnxruntime.ai/.