- WebCrawler: Doesn’t delete old documents matching exclude pattern(s) (#923)
- Webcrawler: HttpHeadersTimeoutException on entrypointUrl causes Webcrawler to delete all documents (#924)
- Webcrawler: Support pagination, but only persist first visit to uri without query and fragment (#926)
1 Like