CrawlerConfig

org.llm4s.rag.loader.CrawlerConfig

See theCrawlerConfig companion class

Attributes

Companion: class
Graph
Supertypes: trait Product

trait Mirror

class Object

trait Matchable

class Any
Self type: CrawlerConfig.type

The names of the product elements

The name of the type

Default configuration with sensible defaults

Aggressive configuration for faster crawling

Conservative configuration for polite crawling

Single page configuration (seed URLs only)

In this article

Generated with