Skip to content

Improve the Solr archetype default configuration setup #2308

Open

Description

@mvolikas

What would you like to be improved?

Following the discussion #2268,

Some Solr archetype defaults are not appropriate for crawls with many different hosts (e.g. solr.status.bucket.maxsize). I've always been testing with the single seed URL https://apache.org/ but maybe it makes sense to update the archetype with a more realistic scenario. For example with the first 100 URLs of Tranco and properties that contribute to an efficient crawl. I remember having modified the default regex and URL filters so those are candidates for update too.

How should we improve?

Something comparable to what is by default with OpenSearch would make sense.

opensearch.status.max.buckets: 50
opensearch.status.max.urls.per.bucket: 2

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions