FetchNodeLevelK is not filtering out `mailto:` links.

[Kilowhisky]

I'm trying to use the new DepthSearchGraph and it appears to be misfiring by trying to follow email links in hrefs. It should filter out non web links.

• mailto:
• tel:

See other schemes that should probably be filtered out: https://www.w3.org/wiki/UriSchemes

https://github.com/ScrapeGraphAI/Scrapegraph-ai/blob/96064f20ee8a849a2548f293419cf9028386c47b/scrapegraphai/nodes/fetch_node_level_k.py#L155C16-L158

EDIT:

It also goes boom navigating javascript links.

- navigating to "javascript:void(0)", waiting until "domcontentloaded"

[VinciGit00]

which model are you using?

[Kilowhisky]

4o-mini.
Not sure if it needs embedding model or not with gpt.

[PeriniM]

Hey @Kilowhisky, it is fixed in the new release!