Spiculecharms Sparkler

Learn about configurations >

• crawldb-uri | string

  Override the auto detected crawldb uri

• fetcher-server-delay | string

  Default: 1000

  Delay (in milliseconds) between two fetch requests for the same host.

• generate-top-groups | string

  Default: 256

  Generates the Top Groups

• generate-topn | string

  Default: 1000

  Generates the top N URLs for fetching.

• kafka-enable | boolean

  Enable Kafka dump

• kafka-listeners | string

  Override the Kafka listeners

• kafka-topic | string

  Default: sparkler_%s

  The Kafka topic

• plugins-bundle-directory | string

  Default: ${project.parent.basedir}${file.separator}${project.bundles.directory}

  Plugins Bundle directory. Configured through Maven.

• spark-master | string

  Override the auto detected spark uri