ONNX Runtime Mobile Pre-Built Package Operator and Type Support#

Supported operators and types#

The supported operators and types are based on what is required to support float32 and quantized versions of popular models. The full list of input models used to determine this list is available here

Supported data input types#

  • float

  • int8_t

  • uint8_t

NOTE: Operators used to manipulate dimensions and indices will support int32 and int64.

Supported Operators#

Operator

Opsets

ai.onnx

ai.onnx:Abs

12, 13, 14, 15

ai.onnx:Add

12, 13, 14, 15

ai.onnx:And

12, 13, 14, 15

ai.onnx:ArgMax

12, 13, 14, 15

ai.onnx:ArgMin

12, 13, 14, 15

ai.onnx:AveragePool

12, 13, 14, 15

ai.onnx:Cast

12, 13, 14, 15

ai.onnx:Ceil

12, 13, 14, 15

ai.onnx:Clip

12, 13, 14, 15

ai.onnx:Concat

12, 13, 14, 15

ai.onnx:ConstantOfShape

12, 13, 14, 15

ai.onnx:Conv

12, 13, 14, 15

ai.onnx:ConvTranspose

12, 13, 14, 15

ai.onnx:Cos

12, 13, 14, 15

ai.onnx:CumSum

12, 13, 14, 15

ai.onnx:DepthToSpace

12, 13, 14, 15

ai.onnx:DequantizeLinear

12, 13, 14, 15

ai.onnx:Div

12, 13, 14, 15

ai.onnx:DynamicQuantizeLinear

12, 13, 14, 15

ai.onnx:Elu

12, 13, 14, 15

ai.onnx:Equal

12, 13, 14, 15

ai.onnx:Erf

12, 13, 14, 15

ai.onnx:Exp

12, 13, 14, 15

ai.onnx:Expand

12, 13, 14, 15

ai.onnx:Flatten

12, 13, 14, 15

ai.onnx:Floor

12, 13, 14, 15

ai.onnx:Gather

12, 13, 14, 15

ai.onnx:GatherND

12, 13, 14, 15

ai.onnx:Gemm

12, 13, 14, 15

ai.onnx:GlobalAveragePool

12, 13, 14, 15

ai.onnx:Greater

12, 13, 14, 15

ai.onnx:GreaterOrEqual

12, 13, 14, 15

ai.onnx:HardSigmoid

12, 13, 14, 15

ai.onnx:Identity

12, 13, 14, 15

ai.onnx:If

12, 13, 14, 15

ai.onnx:InstanceNormalization

12, 13, 14, 15

ai.onnx:LRN

12, 13, 14, 15

ai.onnx:LayerNormalization

1

ai.onnx:LeakyRelu

12, 13, 14, 15

ai.onnx:Less

12, 13, 14, 15

ai.onnx:LessOrEqual

12, 13, 14, 15

ai.onnx:Log

12, 13, 14, 15

ai.onnx:LogSoftmax

12, 13, 14, 15

ai.onnx:Loop

12, 13, 14, 15

ai.onnx:MatMul

12, 13, 14, 15

ai.onnx:MatMulInteger

12, 13, 14, 15

ai.onnx:Max

12, 13, 14, 15

ai.onnx:MaxPool

12, 13, 14, 15

ai.onnx:Mean

12, 13, 14, 15

ai.onnx:Min

12, 13, 14, 15

ai.onnx:Mul

12, 13, 14, 15

ai.onnx:Neg

12, 13, 14, 15

ai.onnx:NonMaxSuppression

12, 13, 14, 15

ai.onnx:NonZero

12, 13, 14, 15

ai.onnx:Not

12, 13, 14, 15

ai.onnx:Or

12, 13, 14, 15

ai.onnx:PRelu

12, 13, 14, 15

ai.onnx:Pad

12, 13, 14, 15

ai.onnx:Pow

12, 13, 14, 15

ai.onnx:QLinearConv

12, 13, 14, 15

ai.onnx:QLinearMatMul

12, 13, 14, 15

ai.onnx:QuantizeLinear

12, 13, 14, 15

ai.onnx:Range

12, 13, 14, 15

ai.onnx:Reciprocal

12, 13, 14, 15

ai.onnx:ReduceMax

12, 13, 14, 15

ai.onnx:ReduceMean

12, 13, 14, 15

ai.onnx:ReduceMin

12, 13, 14, 15

ai.onnx:ReduceProd

12, 13, 14, 15

ai.onnx:ReduceSum

12, 13, 14, 15

ai.onnx:Relu

12, 13, 14, 15

ai.onnx:Reshape

12, 13, 14, 15

ai.onnx:Resize

12, 13, 14, 15

ai.onnx:ReverseSequence

12, 13, 14, 15

ai.onnx:Round

12, 13, 14, 15

ai.onnx:Scan

12, 13, 14, 15

ai.onnx:ScatterND

12, 13, 14, 15

ai.onnx:Shape

12, 13, 14, 15

ai.onnx:Sigmoid

12, 13, 14, 15

ai.onnx:Sin

12, 13, 14, 15

ai.onnx:Size

12, 13, 14, 15

ai.onnx:Slice

12, 13, 14, 15

ai.onnx:Softmax

12, 13, 14, 15

ai.onnx:SpaceToDepth

12, 13, 14, 15

ai.onnx:Split

12, 13, 14, 15

ai.onnx:Sqrt

12, 13, 14, 15

ai.onnx:Squeeze

12, 13, 14, 15

ai.onnx:Sub

12, 13, 14, 15

ai.onnx:Sum

12, 13, 14, 15

ai.onnx:Tanh

12, 13, 14, 15

ai.onnx:ThresholdedRelu

12, 13, 14, 15

ai.onnx:Tile

12, 13, 14, 15

ai.onnx:TopK

12, 13, 14, 15

ai.onnx:Transpose

12, 13, 14, 15

ai.onnx:Unique

12, 13, 14, 15

ai.onnx:Unsqueeze

12, 13, 14, 15

ai.onnx:Where

12, 13, 14, 15

com.microsoft

com.microsoft:DynamicQuantizeMatMul

1

com.microsoft:FusedConv

1

com.microsoft:FusedGemm

1

com.microsoft:FusedMatMul

1

com.microsoft:Gelu

1

com.microsoft:MatMulIntegerToFloat

1

com.microsoft:NhwcMaxPool

1

com.microsoft:QLinearAdd

1

com.microsoft:QLinearAveragePool

1

com.microsoft:QLinearConv

1

com.microsoft:QLinearGlobalAveragePool

1

com.microsoft:QLinearLeakyRelu

1

com.microsoft:QLinearMul

1

com.microsoft:QLinearSigmoid

1