Skip to content

Added pulsar binder support. #631

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

arnogeismar
Copy link

In our organisation we only have a pulsar broker, and we want to avoid using a kafka protocol handler to talk to pulsar

In our organisation we only have a pulsar broker, and we want to avoid using a kafka protocol handler to talk to pulsar

Signed-off-by: Arno Geismar <[email protected]>
@arnogeismar
Copy link
Author

arnogeismar commented May 8, 2025

@onobc my apologies I modified my original PR and signed off on the commit.
At Acerta we are using spring cloud dataflow which leverages spring cloud stream underneath.
Currently spring cloud stream applications only provides kafka and rabbit flavours of stream applications.
We where investigating vendors which could provide us with a kafka protocol handler so that we could use the kafka flavour of stream applications, however because of budgetairy reasons we decided to try to add native pulsar support to the stream applications project.

@onobc
Copy link
Collaborator

onobc commented May 22, 2025

Hi @arnogeismar,

Thank you very much for the PR - it is very thorough (including updating the GH workflows).

I am sorry that I just now noticed it and just now replying - my apologies.

At Acerta we are using spring cloud dataflow which leverages spring cloud stream underneath

Which version of dataflow are you using? Are you using the OSS or commercial version (asking because Spring Cloud Data Flow End of Open-Source).

however because of budgetairy reasons we decided to try to add native pulsar support to the stream applications project.

I do love the idea of adding support for the Pulsar binder. Again, super grateful for you submitting this code proposal, the ultimate cost is not the initial add but rather the ongoing maintenance of another set of the apps to test. We will discuss at our next team meeting and get back w/ you on this PR.

@arnogeismar
Copy link
Author

Hi @onobc,
We are using the latest OSS version but are looking into purchasing an SCDF licence. Talks are currently underway.
I understand the added maintenance cost might be a deal-breaker. For now we forked the project so we can already use the pulsar binder. Looking forward to whatever the team decides.

@cbonami
Copy link

cbonami commented May 26, 2025

Which version of dataflow are you using? Are you using the OSS or commercial version (asking because Spring Cloud Data Flow End of Open-Source).

I am a colleague of Arno. We've been asking at Broadcom for pricing but haven't received a response yet. We're still using the OSS version (latest one available). We are NOT VMWare Tanzu customers, so we are a bit worried.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants