org.llm4s.rag.loader.WebCrawlerLoader
See theWebCrawlerLoader companion class
object WebCrawlerLoader
Attributes
- Companion
- class
- Graph
-
- Supertypes
-
trait Producttrait Mirrorclass Objecttrait Matchableclass Any
- Self type
-
WebCrawlerLoader.type
Members list
Type members
Inherited and Abstract types
The names of the product elements
The names of the product elements
Attributes
- Inherited from:
- Mirror
The name of the type
The name of the type
Attributes
- Inherited from:
- Mirror
Value members
Concrete methods
Create a crawler with a single seed URL.
Create a crawler with a single seed URL.
Attributes
Create a crawler with multiple seed URLs.
Create a crawler with multiple seed URLs.
Attributes
Create a crawler for documentation sites. Uses polite configuration with longer delays.
Create a crawler for documentation sites. Uses polite configuration with longer delays.
Attributes
Create a single-page loader (no link following). Useful when you just want to convert a specific page.
Create a single-page loader (no link following). Useful when you just want to convert a specific page.
Attributes
In this article