New feature optimize_for_inference is not in pip package

[sergiovillanueva]

I can see in the readme that there are a new feature model.optimize_for_inference(), but when I install from pip I can't see this feature, even if I install from github.

[nok]

Hello @sergiovillanueva , you're right, this feature hasn't been released yet. As a workaround, you can install the develop branch directly using:

pip install git+ssh://[email protected]/roboflow/rf-detr.git@develop

In addition there is a small bug in the example code. The method optimize_for_inference() doesn't return anything.

Current:

model = RFDETRBase()
model = model.optimize_for_inference()
# ...
detections = model.predict(image, threshold=0.5)

Fixed:

model = RFDETRBase()
model.optimize_for_inference()  # just call the method
# ...
detections = model.predict(image, threshold=0.5)

I created a small PR for that: #238

---

Finally I'm able to share my experience with this optimization: across all experiments, I measured a speedup ranging from 1.16x to 1.22x.

[isaacrob-roboflow]

hi @nok ! thanks for the catch, my mistake on the README 😅

what hardware are you using? are you happy with that speedup?