News sites missing from the wayback machine

[naseef]

Hi, I am not sure wheather this is the correct place for the issue . Many of the ( or all of the) links in 900_news wikidata links are not getting archived in wayback machine after May 16, 2025. Is it intentional or is it a bug? For example https://www.manoramaonline.com/ and https://www.reporterlive.com/

[Nintendofan885]

Indexing issues for news sites was also mentioned in https://www.niemanlab.org/2025/10/the-wayback-machines-snapshots-of-news-homepages-plummet-after-a-breakdown-in-archiving-projects/ (which got linked on IRC several times)

New captures are listed in the CDX files but aren't being indexed
(https://web.archive.org/web/*/https://news.ycombinator.com/newcomments is an obvious example of this as it went from 1000+ captures a day to only 4/5 (all from SPN) despite new captures being listed in the CDX files)

FYI looks like the WBM summary things for domains and TLDs (e.g. https://web.archive.org/details/tld:gov) now has data up to May 25 (was early January a couple of days ago) which may imply it's more than the URLs project having issues.