Skip to content

DRAFT: Parse refactor #118

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 50 commits into
base: devel
Choose a base branch
from
Draft

DRAFT: Parse refactor #118

wants to merge 50 commits into from

Conversation

lukamac
Copy link
Collaborator

@lukamac lukamac commented Sep 25, 2025 •
edited
Loading

The goal of this PR is to refactor Deeploy's ONNX parsing structure.
First step is extracting the general ONNX operator assumptions into the OperatorDescriptor and using it to canonicalize the graph.
Next step would be to use the descriptor for parsing.

Operator checklist

  • Add
  • CLCA
  • Concat
  • Conv
  • DebugPrint
  • Dequant
  • Div
  • Flatten
  • Gather
  • Gelu
  • Gemm
  • ITAMax
  • ITAPartialMax
  • IntegerDiv
  • IntegerMean
  • LayerNormalization
  • LinearAttention
  • MHSA
  • MatMul
  • MatMulInteger
  • MaxPool
  • Mul
  • Pad
  • Quant
  • RQGemm
  • RQIntegerDiv
  • RQMatMul
  • ReduceMean
  • ReduceSum
  • Relu
  • RequantShift
  • RequantizedAdd
  • RequantizedConv
  • RequantizedGemm
  • RequantizediGELU
  • RequantizediHardswish
  • Reshape
  • SGD
  • Slice
  • Softmax
  • SoftmaxCrossEntropyLoss
  • SoftmaxCrossEntropyLossGrad
  • SoftmaxGrad
  • Squeeze
  • Transpose
  • Unsqueeze
  • iGELU
  • iHardswish
  • iLayerNorm
  • iNoNorm
  • iRMSNorm
  • iSoftmax

Added

  • OperatorDescriptor, IoDescriptor, AttrDescriptor

Changed

Fixed

PR Merge Checklist

  1. The PR is rebased on the latest devel commit and pointing to devel.
  2. Your PR reviewed and approved.
  3. All checks are passing.
  4. The CHANGELOG.md file has been updated.
  5. If the docker was modified, change back its link after review.

@lukamac
Add OperatorDescriptor
2fef505
@lukamac
Add OperatorDescriptor.py
0de102b
@lukamac
Add operatorDescriptors to NetworkDeployers
53f6ffd
@lukamac
Fix extract padding pass
8667a3e
@lukamac
Fix isoftmax parser
f2313b8
@lukamac
Fix iRMSNorm and iNoNorm parsers
ea53d8a
@lukamac
Fix ReduceMean type signature
5d06abe
@lukamac
Fix itamax and itapartialmax parsers
61f3cd3
@lukamac
Fix attr comparison to compare with tuple in neureka
ff6295d
@lukamac
Fix keepdims type in fuse mhsa pass
e020bcf
@lukamac
Fix old _unpack_const to pass Python literals
0ea884c
@lukamac
Canonicalize before checking
83475bd
@lukamac
Add RequantizedConv desc
486e873
@lukamac
Fix DW parser
cf5659a
@lukamac
Fix pulp 1D conv
31603a3
@lukamac
Improve error message
53a9a82
@lukamac
Fix CortexM RequantizedConv by adding an optional shift tensor
eb1241c
@lukamac
Sort operator descriptors alphabetically
d4bab8f
@lukamac
Add DequantDescriptor
4a5d6a6
@lukamac
Add Div, IntegerDiv, RQIntegerDiv
6472cf3
@lukamac
Add DebugPrint, LayerNormalization, iLayerNorm
d917e4e
@lukamac
Add RequantizedOperatorDescriptor
07675d8
@lukamac
Add flatten and gather
9806509
@lukamac
Add Squeeze and Unsqueeze
610e530
@lukamac
Fix single item attr that should be a tuple problem
71a21f1
@lukamac
Catch all exceptions when unpacking attributes
f58efbf
@lukamac
Add Mul
7638c35
@lukamac
Add MatMul, RQMatMul, MatMulInteger
54e5b57
@lukamac
Broadcast refactor
b10c0a5
@lukamac
Add Gemm and RQGemm
ecaa4cd
@lukamac
Add LinearAttention
9db5e10
@lukamac
Add RequantizedGemm
d256432
@lukamac
Add CLCA
19992ec
@lukamac
Add IntegerMean
b62203e
@lukamac
Add MHSA
d578a32
@lukamac
Fix RequantizedGemm
2193c64
@lukamac
Add Relu, Reshape, RequantShift
c0f5ae1
@lukamac
Fix ConstUnpack for 0-dim numpy arrays
a756f6e
@lukamac
Add RequantizedAdd
378594e
@lukamac
Fix MHSA requant information being unpacked to Int unstead of IntTuple
d7113f8
@lukamac
Add RequantizediHardswish
e192acc
@lukamac
Fixup forgot to use the RequantizedAddDescriptor
bcc699c
@lukamac
Add iGELU
4540231
@lukamac
Add SoftmaxCrossEntropyLoss(Grad)
a1dc797
@lukamac
Assert that a operator descriptor exists
c80236b
@lukamac
Add Memcopy for dma tests
5d634a4
@lukamac
Add missing Gemm and RQGemm descriptors to defaultOperatorDescriptors
3c18467
@lukamac
Fix transA and transB being treated like ints
6c91310
@lukamac
Fix MHSA requant field unpackers for MemPool
05a2a4a
@lukamac
Fix MHSA requant fields needing to be ints when single item and tuple…
779b51c 
…s when multiitem
@Xeratec Xeratec added this to Deeploy Sep 29, 2025
@Xeratec Xeratec added this to the Release 0.3.0 milestone Sep 29, 2025
@Xeratec Xeratec moved this to Need Reviewer in Deeploy Sep 29, 2025
@Xeratec Xeratec linked an issue Sep 29, 2025 that may be closed by this pull request
Freeze ONNX Opset #95
Open
@Xeratec Xeratec mentioned this pull request Sep 29, 2025
Merged
5 tasks
@Xeratec Xeratec moved this from Need Reviewer to In review in Deeploy Sep 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Victor-Jung Victor-Jung Awaiting requested review from Victor-Jung Victor-Jung will be requested when the pull request is marked ready for review Victor-Jung is a code owner

@Xeratec Xeratec Awaiting requested review from Xeratec Xeratec will be requested when the pull request is marked ready for review Xeratec is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

@lukamac lukamac

Labels

Feature

Projects

Deeploy
Status: In review

Milestone

Release 0.3.0

Development

Successfully merging this pull request may close these issues.

Freeze ONNX Opset

2 participants

@lukamac @Xeratec