Replies: 1 comment
-
|
Best way seems to be to implement your own crawler queue following the provided interface (e.g. using Redis) so that you can easily store/restore the state of the crawler queue. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Is there any good/easy way to pause a crawl and restart from that point later in time?
Beta Was this translation helpful? Give feedback.
All reactions