-
Notifications
You must be signed in to change notification settings - Fork 10
Open
Description
We should add some conditions/check (try/except) to handle the scraping while the site are down.
We should improve the requests retries like: https://stackoverflow.com/questions/15431044/can-i-set-max-retries-for-requests-request
Error log:
HTTPConnectionPool(host='www.dei.unict.it', port=80): Max retries exceeded with url: /Comunicazioni/elenco-eventi_dei (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f0003434710>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))
urllib3 HTTPError HTTPSConnectionPool(host='api.telegram.org', port=443): Max retries exceeded with url: /bot$TOKEN/sendMessage (Caused by NewConnectionError('<telegram.vendor.ptb_urllib3.urllib3.connection.VerifiedHTTPSConnection object at 0x7f479fc75390>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',)) @deinews
This could be also for a temporary offline unict server.
Metadata
Metadata
Assignees
Labels
No labels