Skip to content

Add url template for specific url crawling  #28

@code4craft

Description

@code4craft

Crawling specific urls instead of discover and crawl links for pages.
Use url template like "http://baike.baidu.com/search/word?word=${word}&enc=utf8" and params as input.
It's similar to harvestman.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions