Skip to content

feat: add HR onboarding automation example #26

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 6 commits into
base: main
Choose a base branch
from

Conversation

Anshgrover23
Copy link
Contributor

@Anshgrover23 Anshgrover23 commented May 17, 2025

/claim #24

2025-05-18.02-15-22.mp4

17 LegacyHRBot Resume → onboarding app fill Extract name + phone from resume → fill onboarding form in dummy app $150

@louis030195
Copy link
Contributor

nice!

why is there an electron app?

to simulate fake app to fill i recommend just publishing app to v0 and install as desktop native (one click)

any chance to make it more general and leverage tool calling?

example: https://gist.github.com/louis030195/53510c5fcfc2733117209617f81db056

basically get full tree of input and output and give to the llm that decide which elemnt to fill text / click using ID as selector

also use clipboard true in the type text make it 1000x faster fyi

@Anshgrover23
Copy link
Contributor Author

@louis030195 done with changes? can u tell do we wanted to make this more general?

@Anshgrover23 Anshgrover23 requested a review from louis030195 May 20, 2025 19:13
@Ani-4x
Copy link

Ani-4x commented May 21, 2025

@Anshgrover23 Hi . while i was trying to use the "desktop-use" module , it gives an error that it cannot find the module . and at the file location "ts-sdk" it has created infinite sub folder inside one another as the name "desktop-use".
I wanted to ask , did you get the same error? or if you don't mind can you help me with this.
Thanks
image

@Anshgrover23
Copy link
Contributor Author

@Ani-4x You need to use npm instead of bun
bun doesnt support importing modules from file:
therefore use npm only

@louis030195
Copy link
Contributor

can you make this work for any job application app?

that would be amazing

also curious your experience with the drop down elements, been thinking if i should implement some specific function(s) to deal with dropdown and such more easily

@Anshgrover23
Copy link
Contributor Author

Anshgrover23 commented May 21, 2025

@louis030195 Yup . we can do that , but I will do that in next PR , since doing it here will clutter up things

BTW, the most dropdown elements like splitbuttons , radiobuttons have a pattern expandcollapse , as in the windows ui automation, so we can use that

currently I used to lookup those elements as they show up in the tree after we click on that dropdown menu button

so , you can implement .expand()

@Ani-4x
Copy link

Ani-4x commented May 21, 2025

@Anshgrover23 I have tried using npm but still the only the "desktop-use" module is giving error , as i look into node modules it uses a symbolic link, there might be a way around this , i will try .
btw thanks

@louis030195
Copy link
Contributor

whats the status of this? still would prefer something useful that people can use

can you do another video demo? also i recommend editing video with

https://www.capcut.com/
https://www.kapwing.com/
https://www.descript.com/

or anything else

so i can share the demo on reddit or whatever

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants