Skip to content

[23/n] tensor engine, implement rref on actor endpoints #625

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 6 commits into from

Conversation

zdevito
Copy link
Contributor

@zdevito zdevito commented Jul 23, 2025

Stack from ghstack (oldest at bottom):

Allows actor endpoints to take tensors as arguments and return them as monarch.Tensor objects.

Actor endpoints that do this must have a propagator function defined.

"cached" does not currently work because the caching machinery cannot make the actor call.

Introduces as_endpoint() which can take something that was not annotated on a class and turn it into an endpoint. This is useful when needing to define a per-actor propagation function for rref calls because there otherwise is nowhere to put it.

Differential Revision: D78782587

NOTE FOR REVIEWERS: This PR has internal Meta-specific changes or comments, please review them on Phabricator!

Allows actor endpoints to take tensors as arguments and return them as monarch.Tensor objects.

Actor endpoints that do this must have a propagator function defined.

"cached" does not currently work because the caching machinery cannot make the actor call.

Introduces `as_endpoint()` which can take something that was not annotated on a class and turn it into an endpoint. This is useful when needing to define a per-actor propagation function for rref calls because there otherwise is nowhere to put it.

Differential Revision: [D78782587](https://our.internmc.facebook.com/intern/diff/D78782587/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D78782587/)!

[ghstack-poisoned]
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Jul 23, 2025
zdevito added a commit that referenced this pull request Jul 23, 2025
Allows actor endpoints to take tensors as arguments and return them as monarch.Tensor objects.

Actor endpoints that do this must have a propagator function defined.

"cached" does not currently work because the caching machinery cannot make the actor call.

Introduces `as_endpoint()` which can take something that was not annotated on a class and turn it into an endpoint. This is useful when needing to define a per-actor propagation function for rref calls because there otherwise is nowhere to put it.

Differential Revision: [D78782587](https://our.internmc.facebook.com/intern/diff/D78782587/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D78782587/)!

ghstack-source-id: 297921095
Pull Request resolved: #625
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78782587

Allows actor endpoints to take tensors as arguments and return them as monarch.Tensor objects.

Actor endpoints that do this must have a propagator function defined.

"cached" does not currently work because the caching machinery cannot make the actor call.

Introduces `as_endpoint()` which can take something that was not annotated on a class and turn it into an endpoint. This is useful when needing to define a per-actor propagation function for rref calls because there otherwise is nowhere to put it.

Differential Revision: [D78782587](https://our.internmc.facebook.com/intern/diff/D78782587/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D78782587/)!

[ghstack-poisoned]
zdevito added a commit that referenced this pull request Jul 23, 2025
Pull Request resolved: #625

Allows actor endpoints to take tensors as arguments and return them as monarch.Tensor objects.

Actor endpoints that do this must have a propagator function defined.

"cached" does not currently work because the caching machinery cannot make the actor call.

Introduces `as_endpoint()` which can take something that was not annotated on a class and turn it into an endpoint. This is useful when needing to define a per-actor propagation function for rref calls because there otherwise is nowhere to put it.

Differential Revision: [D78782587](https://our.internmc.facebook.com/intern/diff/D78782587/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D78782587/)!
ghstack-source-id: 298066447
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78782587

Allows actor endpoints to take tensors as arguments and return them as monarch.Tensor objects.

Actor endpoints that do this must have a propagator function defined.

"cached" does not currently work because the caching machinery cannot make the actor call.

Introduces `as_endpoint()` which can take something that was not annotated on a class and turn it into an endpoint. This is useful when needing to define a per-actor propagation function for rref calls because there otherwise is nowhere to put it.

Differential Revision: [D78782587](https://our.internmc.facebook.com/intern/diff/D78782587/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D78782587/)!

[ghstack-poisoned]
zdevito added a commit that referenced this pull request Jul 23, 2025
Pull Request resolved: #625

Allows actor endpoints to take tensors as arguments and return them as monarch.Tensor objects.

Actor endpoints that do this must have a propagator function defined.

"cached" does not currently work because the caching machinery cannot make the actor call.

Introduces `as_endpoint()` which can take something that was not annotated on a class and turn it into an endpoint. This is useful when needing to define a per-actor propagation function for rref calls because there otherwise is nowhere to put it.
ghstack-source-id: 298177101

Differential Revision: [D78782587](https://our.internmc.facebook.com/intern/diff/D78782587/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D78782587/)!
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78782587

Allows actor endpoints to take tensors as arguments and return them as monarch.Tensor objects.

Actor endpoints that do this must have a propagator function defined.

"cached" does not currently work because the caching machinery cannot make the actor call.

Introduces `as_endpoint()` which can take something that was not annotated on a class and turn it into an endpoint. This is useful when needing to define a per-actor propagation function for rref calls because there otherwise is nowhere to put it.

Differential Revision: [D78782587](https://our.internmc.facebook.com/intern/diff/D78782587/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D78782587/)!

[ghstack-poisoned]
zdevito added a commit that referenced this pull request Jul 24, 2025
Pull Request resolved: #625

Allows actor endpoints to take tensors as arguments and return them as monarch.Tensor objects.

Actor endpoints that do this must have a propagator function defined.

"cached" does not currently work because the caching machinery cannot make the actor call.

Introduces `as_endpoint()` which can take something that was not annotated on a class and turn it into an endpoint. This is useful when needing to define a per-actor propagation function for rref calls because there otherwise is nowhere to put it.
ghstack-source-id: 298207691

Differential Revision: [D78782587](https://our.internmc.facebook.com/intern/diff/D78782587/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D78782587/)!
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78782587

Allows actor endpoints to take tensors as arguments and return them as monarch.Tensor objects.

Actor endpoints that do this must have a propagator function defined.

"cached" does not currently work because the caching machinery cannot make the actor call.

Introduces `as_endpoint()` which can take something that was not annotated on a class and turn it into an endpoint. This is useful when needing to define a per-actor propagation function for rref calls because there otherwise is nowhere to put it.

Differential Revision: [D78782587](https://our.internmc.facebook.com/intern/diff/D78782587/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D78782587/)!

[ghstack-poisoned]
zdevito added a commit that referenced this pull request Jul 24, 2025
Pull Request resolved: #625

Allows actor endpoints to take tensors as arguments and return them as monarch.Tensor objects.

Actor endpoints that do this must have a propagator function defined.

"cached" does not currently work because the caching machinery cannot make the actor call.

Introduces `as_endpoint()` which can take something that was not annotated on a class and turn it into an endpoint. This is useful when needing to define a per-actor propagation function for rref calls because there otherwise is nowhere to put it.
ghstack-source-id: 298227639

Differential Revision: [D78782587](https://our.internmc.facebook.com/intern/diff/D78782587/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D78782587/)!
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78782587

Allows actor endpoints to take tensors as arguments and return them as monarch.Tensor objects.

Actor endpoints that do this must have a propagator function defined.

"cached" does not currently work because the caching machinery cannot make the actor call.

Introduces `as_endpoint()` which can take something that was not annotated on a class and turn it into an endpoint. This is useful when needing to define a per-actor propagation function for rref calls because there otherwise is nowhere to put it.

Differential Revision: [D78782587](https://our.internmc.facebook.com/intern/diff/D78782587/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D78782587/)!

[ghstack-poisoned]
zdevito added a commit that referenced this pull request Jul 25, 2025
Pull Request resolved: #625

Allows actor endpoints to take tensors as arguments and return them as monarch.Tensor objects.

Actor endpoints that do this must have a propagator function defined.

"cached" does not currently work because the caching machinery cannot make the actor call.

Introduces `as_endpoint()` which can take something that was not annotated on a class and turn it into an endpoint. This is useful when needing to define a per-actor propagation function for rref calls because there otherwise is nowhere to put it.
ghstack-source-id: 298650755

Differential Revision: [D78782587](https://our.internmc.facebook.com/intern/diff/D78782587/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D78782587/)!
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78782587

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in e579c25.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Meta Open Source bot. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants