Skip to content

Handle fail http request to site #6

@Helias

Description

@Helias

We should add some conditions/check (try/except) to handle the scraping while the site are down.

We should improve the requests retries like: https://stackoverflow.com/questions/15431044/can-i-set-max-retries-for-requests-request

Error log:

HTTPConnectionPool(host='www.dei.unict.it', port=80): Max retries exceeded with url: /Comunicazioni/elenco-eventi_dei (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f0003434710>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))

('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))

urllib3 HTTPError HTTPSConnectionPool(host='api.telegram.org', port=443): Max retries exceeded with url: /bot$TOKEN/sendMessage (Caused by NewConnectionError('<telegram.vendor.ptb_urllib3.urllib3.connection.VerifiedHTTPSConnection object at 0x7f479fc75390>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',)) @deinews

This could be also for a temporary offline unict server.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions