ClwySpider/items.py

定义要爬取的属性

import scrapy


class ClwyspiderItem(scrapy.Item):
    # 标题
    title = scrapy.Field()

    # 详情连接
    url = scrapy.Field()

    # 图片
    image = scrapy.Field()

    # 日期
    date = scrapy.Field()

    # 描述
    description = scrapy.Field()

    # 标签
    tags = scrapy.Field()

生成蜘蛛

scrapy genspider course "clwy.cn"

打开 ClwySpider/spiders/cousrs.py，这里就是蜘蛛文件了

import scrapy
from ClwySpider.items import Clwysp...