🌱 Open Source

🌍 Live Open Source Explorer

Explore live open-source projects and AI models.

Search public open-source repositories from GitHub and AI models from Hugging Face. Every page shows 10 results with clean pagination.

🔎 Live Search

Search live open-source data

Search GitHub repositories and Hugging Face models directly, then explore stars, downloads, source links and project details.

Reset Search
🔎
🌐

Try keywords like automation, CRM, analytics, chatbot, llama or workflow.

Choose where to search live data.

Live Results

GitHub Open Source Repositories

Search: scrapy_redis_mongodb

Page 1

Showing 8 results from 8

D

gnemoug/distribute_crawler

GitHub Python

使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现

★ 3,244 Forks 1,562 gnemoug Updated 23 Jun 2026
T

shisiying/tc_zufang

GitHub CSS

使用scrapy,redis, mongodb,django实现的一个分布式网络爬虫,底层存储mongodb,分布式使用redis实现,使用django可视化爬虫

★ 280 Forks 125 shisiying Updated 19 May 2026
D

zhangslob/docs

GitHub

《数据采集从入门到放弃》源码。内容简介:爬虫介绍、就业情况、爬虫工程师面试题 ;HTTP协议介绍; Requests使用 ;解析器Xpath介绍; MongoDB与MySQL; 多线程爬虫; Scrapy介绍 ;Scrapy-redis介绍; 使用docker部署; 使用nomad管理docker集群; 使用EFK查询docker日志

★ 137 Forks 30 zhangslob Updated 10 Apr 2026
S

smilemilk1992/scrapy_redis_mongodb

GitHub Python

基于Python+scrapy+redis的分布式爬虫实现框架

★ 59 Forks 34 smilemilk1992 Updated 24 Aug 2025
P

hemslo/poky-engine

GitHub Python

A simple search engine in python using Tornado, Scrapy, Redis and MongoDB

★ 24 Forks 9 hemslo Updated 27 Oct 2023
S

Fazx/Scrapy_spider

GitHub Python

基于Scrapy-Redis框架与Mongodb的分布式爬虫-elasticsearch搜索引擎打造

★ 18 Forks 6 Fazx Updated 06 Apr 2024
W

AlanConstantine/WebCrawlerforGameofThrones

GitHub Python

使用Scrapy结合redis和mongodb设计分布式爬虫

★ 13 Forks 3 AlanConstantine Updated 03 May 2022
C

CoderDon/Crawler

GitHub Python

分布式爬虫小项目,爬取豆瓣TOP250,采用Scrapy、Scrapy-Redis、MongoDB、Flask、Echarts、WordCloud等技术实现

★ 11 Forks 1 CoderDon Updated 11 Nov 2024