osc-group/osc
1
1
Fork 0
Code Pull Requests Projects Wiki Activity

Compare commits

base: osc-group:45110c22d39021694be3f49320229dae8c3d618b
Branches Tags
osc-group:main
...
compare: osc-group:bbacb8e1a00354c91196b1bdd0d43014424bebb2
Branches Tags
osc-group:main

2 Commits
45110c22d3 ... bbacb8e1a0

Author SHA1 Message Date
yuxin-pc
bbacb8e1a0 补充缺少文件 2025-07-23 15:34:03 +08:00
yuxin-pc
95ee8f5f59 Update WeiboUserSpider.py 
批次大小和间隔时间修改
 2025-07-23 15:33:43 +08:00
5 changed files with 14 additions and 3 deletions
Show Stats Expand all files Collapse all files

2
spiders/MediaSpiders/MediaSpiders/spiders/WeiboUserSpider.py
View File

@ -25,6 +25,8 @@ class WeiboSpider(scrapy.Spider):
'FILES_RESULT_FIELD': 'es_video', 'FILES_RESULT_FIELD': 'es_video',
'ZIP_FILE_NAME': 'image_data_publicinfo_', 'ZIP_FILE_NAME': 'image_data_publicinfo_',
'FILE_ZIP_FILE_NAME': 'image_data_plane_', 'FILE_ZIP_FILE_NAME': 'image_data_plane_',
'DOWNLOAD_DELAY': 3,
'BATCH_SAVE_SIZE': 20,
'ITEM_PIPELINES': { 'ITEM_PIPELINES': {
'scrapy.pipelines.images.ImagesPipeline': 2, 'scrapy.pipelines.images.ImagesPipeline': 2,
'scrapy.pipelines.files.FilesPipeline': 1, 'scrapy.pipelines.files.FilesPipeline': 1,

BIN
xxl-job/xxl-job-admin/src/main/resources/static/adminlte/xxldist/css/AdminLTE.min.css (Stored with Git LFS) vendored Normal file
View File

Binary file not shown.

BIN
xxl-job/xxl-job-admin/src/main/resources/static/adminlte/xxldist/css/skins/_all-skins.min.css (Stored with Git LFS) vendored Normal file
View File

Binary file not shown.

BIN
xxl-job/xxl-job-admin/src/main/resources/static/adminlte/xxldist/js/adminlte.min.js (Stored with Git LFS) vendored Normal file
View File

Binary file not shown.

6
xxl-job/xxl-job-admin/src/main/resources/templates/common/common.macro.ftl
View File

@ -14,9 +14,9 @@
<!-- Ionicons --> <!-- Ionicons -->
<link rel="stylesheet" href="${request.contextPath}/static/adminlte/bower_components/Ionicons/css/ionicons.min.css"> <link rel="stylesheet" href="${request.contextPath}/static/adminlte/bower_components/Ionicons/css/ionicons.min.css">
<!-- Theme style --> <!-- Theme style -->
<link rel="stylesheet" href="${request.contextPath}/static/adminlte/dist/css/AdminLTE.min.css"> <link rel="stylesheet" href="${request.contextPath}/static/adminlte/xxldist/css/AdminLTE.min.css">
<!-- AdminLTE Skins. Choose a skin from the css/skins folder instead of downloading all of them to reduce the load. --> <!-- AdminLTE Skins. Choose a skin from the css/skins folder instead of downloading all of them to reduce the load. -->
<link rel="stylesheet" href="${request.contextPath}/static/adminlte/dist/css/skins/_all-skins.min.css"> <link rel="stylesheet" href="${request.contextPath}/static/adminlte/xxldist/css/skins/_all-skins.min.css">
<!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries --> <!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries -->
<!-- WARNING: Respond.js doesn't work if you view the page via file:// --> <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
@ -41,7 +41,7 @@
<!-- FastClick --> <!-- FastClick -->
<script src="${request.contextPath}/static/adminlte/bower_components/fastclick/fastclick.js"></script> <script src="${request.contextPath}/static/adminlte/bower_components/fastclick/fastclick.js"></script>
<!-- AdminLTE App --> <!-- AdminLTE App -->
<script src="${request.contextPath}/static/adminlte/dist/js/adminlte.min.js"></script> <script src="${request.contextPath}/static/adminlte/xxldist/js/adminlte.min.js"></script>
<!-- jquery.slimscroll --> <!-- jquery.slimscroll -->
<script src="${request.contextPath}/static/adminlte/bower_components/jquery-slimscroll/jquery.slimscroll.min.js"></script> <script src="${request.contextPath}/static/adminlte/bower_components/jquery-slimscroll/jquery.slimscroll.min.js"></script>