🌱 Open Source

🌍 Live Open Source Explorer

Explore live open-source projects and AI models.

Search public open-source repositories from GitHub and AI models from Hugging Face. Every page shows 10 results with clean pagination.

🔎 Live Search

Search live open-source data

Search GitHub repositories and Hugging Face models directly, then explore stars, downloads, source links and project details.

Reset Search
🔎
🌐

Try keywords like automation, CRM, analytics, chatbot, llama or workflow.

Choose where to search live data.

Live Results

GitHub Open Source Repositories

Search: scrapy-mongodb

Page 4

Showing 10 results from 42

S

krizten/Scraping-Jumia-Ecommerce

GitHub Python

Using the Scrapy framework to scrape data consisting of name, brand, rating, price, product URL and image URLs of laptops on Jumia e-commerce (https://www.jumia.com.ng) into XLSX, SQL and MongoDB.

★ 17 Forks 14 krizten Updated 19 Apr 2026
R

ywcmaike/recommender_system

GitHub Python

使用scrapy框架爬取微博数据存储到mongodb中,利用numpy/tensorflow等python库对数据进行处理(基于transE算法),形成推荐系统。使用Springboot框架实现系统的可视化。有不同分支,master、transE、spring分别存储不同的模块。

★ 17 Forks 9 ywcmaike Updated 15 Jan 2026
T

adipasquale/techcrunch-incremental-scrapy-spider-with-mongodb

GitHub Python

Techcrunch Incremental Scrapy Spider With MongoDB

★ 16 Forks 6 adipasquale Updated 06 Aug 2023
W

gyqlr/weibo_spider

GitHub Python

微博爬虫,爬去微博语料,情感分析,user-agent池,充足IP,scrapy,mongodb

★ 15 Forks 4 gyqlr Updated 18 May 2026
X

mingsage/XHS-SPIDER

GitHub Python

基于Scrapy框架的小红书数据采集系统,支持图文/视频笔记元数据抓取、用户信息采集、评论数据获取,并集成MongoDB存储。

★ 14 Forks 3 mingsage Updated 24 Jun 2026
S

darthbear/scrapy-mongodb-queue

GitHub Python

Use scrapy with mongodb to store the request queues (FIFO or LIFO)

★ 13 Forks 13 darthbear Updated 10 Oct 2019
S

xiaowangwindow/scrapy-httpcache

GitHub Python BSD 3-Clause "New" or "Revised" License

A scrapy middleware to save http cache to MongoDB

★ 13 Forks 8 xiaowangwindow Updated 30 May 2024
S

zenream/scrapy_mongodb_django

GitHub CSS

通过django将scrapy爬取存储到mongodb的数据展示到web页面,增删改查等功能

★ 13 Forks 3 zenream Updated 07 Aug 2025
W

AlanConstantine/WebCrawlerforGameofThrones

GitHub Python

使用Scrapy结合redis和mongodb设计分布式爬虫

★ 13 Forks 3 AlanConstantine Updated 03 May 2022
N

chl17/NDRC-NEA-Scraper

GitHub Python

国家发改委 国家能源局 爬虫,使用Scrapy, MongoDB, Elasticsearch, ReactiveSearch

★ 12 Forks 5 chl17 Updated 28 Jun 2025
Pagination Page 4 of 5

10 results on this page · 42 total found

Showing first 42 accessible GitHub results.