CVE-2024-0243 Information

Description

With the following crawler configuration:

from bs4 import BeautifulSoup as Soup

url = \https://example.com\nloader = RecursiveUrlLoader(
    url=url max_depth=2 extractor=lambda x: Soup(x \html.parser\).text
)
docs = loader.load()

An attacker in control of the contents of https://example.com could place a malicious HTML file in there with links like \https://example.completely.different/my_file.html\ and the crawler would proceed to download that file as well even though prevent_outside=True.

https://github.com/langchain-ai/langchain/blob/bf0b3cc0b5ade1fb95a5b1b6fa260e99064c2e22/libs/community/langchain_community/document_loaders/recursive_url_loader.pyL51-L51

Resolved in https://github.com/langchain-ai/langchain/pull/15559

Reference

https://huntr.com/bounties/370904e7-10ac-40a4-a8d4-e2d16e1ca861 https://github.com/langchain-ai/langchain/commit/bf0b3cc0b5ade1fb95a5b1b6fa260e99064c2e22 With the following crawler configuration:

from
bs4
import
BeautifulSoup
as
Soup

url
=
\[***https://example.com\nloader***](https://example.com\nloader)
=
RecursiveUrlLoader(




url=url
max_depth=2
extractor=lambda
x:
Soup(x
\html.parser\).text
)
docs
=
loader.load()

An attacker in control of the contents of [***https://example.com***](https://example.com) could place a malicious HTML file in there with links like \[***https://example.completely.different/my_file.html\***](https://example.completely.different/my_file.html\) and the crawler would proceed to download that file as well even though prevent_outside=True`.

https://github.com/langchain-ai/langchain/blob/bf0b3cc0b5ade1fb95a5b1b6fa260e99064c2e22/libs/community/langchain_community/document_loaders/recursive_url_loader.py#L51-L51

Resolved in https://github.com/langchain-ai/langchain/pull/15559