No |
PID |
State |
{% for crawler in crawlers %}
---|---|---|
{{ crawler.worker_no }} | {{ crawler.pid }} | {{ crawler.state }} |
Url |
Crawl next |
Crawled last |
{% for doc in queue %}
||||
---|---|---|---|---|---|---|
{{ doc.url }} | {% if doc.worker_no is not None %}In progress | {% elif doc.crawl_last is None or doc.crawl_next < now %}Pending | {% elif doc.crawl_next and doc.pending %}{{ doc.crawl_next_human }} | {% else %}{% endif %} {% if doc.crawl_last %} | {{ doc.crawl_last_human }} | {% else %}{% endif %} |