-
Hi! Based on #284, I've created a cost class which currently I've tested that works. Trying to debug, I've created a logger like I've seen in other classes: private static final Logger logger = Logger.getLogger(PUCCostAssignmentPolicy.class.getName()); The problem I'm facing is that the logging content is being shared across all the crawling jobs in the path I've tried to dig into the code and see how the logs and reports are implemented, but it seems that the reports are intended for general statistics or purposes, so I don't know if what I'm trying to achieve fits there. I've seen that reports are registered in Thank you! PS: I've seen very interesting questions/discussions in the issue section. How about enabling and using the discussions section? I think it would be very interesting in order to, for example, avoid to "forget" old questions. There's a "Q&A" section there that fits perfectly (e.g. https://github.com/bitextor/bitextor/discussions/categories/q-a) |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 2 replies
-
I asked on the IIPC Slack and a few people agreed with this suggestion and nobody dissented so I've enabled the discussions section and moved most of the existing questions here. (Just answering this part as I'm not familiar with the logging/reporting code.) |
Beta Was this translation helpful? Give feedback.
-
Hi! I've finally got it! Example of a new log (not report) working: cgr71ii@c9be5b3 Main different I've observed between log and report: logs are updated frequently, reports need to be opened to trigger the update unless that Main steps in order to create a new log:
PS: thanks for the discussions section! I think it fits very well in this project. |
Beta Was this translation helpful? Give feedback.
Hi! I've finally got it!
Example of a new log (not report) working: cgr71ii@c9be5b3
Main different I've observed between log and report: logs are updated frequently, reports need to be opened to trigger the update unless that
shouldReportAtEndOfCrawl
is set tofalse
. I guess that the report goal is to have a file which is totally rewritten, and since we're crawling, we don't want that in order to avoid to slow down the disk operations. Since logs are intended to append text, this is not such a critic problem (hypothesis).Main steps in order to create a new log:
engine/src/main/java/org/archive/crawler/util/Logs.java
.engine/src/main/java/org/archive/crawler/reporting…