13 Commits

Author SHA1 Message Date
DELL
0008e619d1 [Twitter]删除多余注释 2026-01-20 16:35:35 +08:00
DELL
399165404e [通用翻译] 功能提交 2026-01-20 16:13:05 +08:00
DELL
9a36e9c5b5 [20260119]1、微信公众号扫码的脚本,改成调用Selenium Chrome,2、将TW、FB、微信公众号扫描调用Selenium的部分,抽象成一个方法;3、scrapy 框架 命令行启动注释 2026-01-19 17:18:53 +08:00
DELL
488bc2fdca Merge remote-tracking branch 'origin/main'
# Conflicts:
#	spiders/MediaSpiders/MediaSpiders/scrapy_selenium/middlewares.py
#	spiders/MediaSpiders/MediaSpiders/settings.py
#	spiders/MediaSpiders/MediaSpiders/spiders/TwitterUserSpider.py
#	spiders/MediaSpiders/run.py
2026-01-19 14:09:58 +08:00
yuxin-pc
89df3771e7 同步近期采集更改 2026-01-19 09:17:26 +08:00
DELL
a69ff25ce4 [twitterSpider]1、新增仿生物操作配置,2、修改业务逻辑,若自动化获取Cookie失败,则直接从redis中获取cookie;3、修改采集信息json层级 2026-01-16 16:30:41 +08:00
yuxin-pc
afe6c34db7 Update settings.py
调用服务地址改变
2025-12-23 13:46:47 +08:00
yuxin-pc
95ee8f5f59 Update WeiboUserSpider.py
批次大小和间隔时间修改
2025-07-23 15:33:43 +08:00
yuxin-pc
45110c22d3 Update WeiboUserSpider.py
适配新的ID
2025-07-22 15:11:06 +08:00
yuxin-pc
62fa085ec7 Update wechat_links_fetcher.py
更新UA
2025-06-24 09:47:08 +08:00
yuxin-pc
58bdf5cc0c Update middlewares.py
采集开始时显示并发线程
2025-06-13 09:41:04 +08:00
yuxin-pc
8f1999376f Update settings.py
配置项改回ZQ
2025-06-13 09:40:52 +08:00
yuxin-pc
cf4a6e2854 init 2025-05-28 19:16:17 +08:00