cabrit0 mcp server reuneMacacada

WHAT IT CONNECTS

cabrit0 mcp server reuneMacacada 为 AI Agent 提供什么

• Generate learning paths for any topic (not just technology topics)
• Find relevant resources using web search and scraping
• Organize resources into a logical sequence with customizable number of nodes
• Support for multiple languages with focus on Portuguese
• Performance optimizations for Render's free tier
• Caching system for faster responses
• Return a standardized JSON structure for consumption by client applications
• **NEW**: TF-IDF based resource relevance filtering to ensure resources match the requested topic
• **NEW**: Strategic quiz distribution across learning trees for balanced learning experiences
• **NEW**: YouTube integration to include relevant videos in learning paths
• **NEW**: Category system to generate more specific content for different types of topics
• **NEW**: Asynchronous task system with real-time progress feedback to improve user experience and avoid timeouts
• **NEW**: Enhanced caching system for improved performance and faster response times
• **NEW**: Optimized web scraping techniques for better resource utilization
• **NEW**: Adaptive scraping system that automatically chooses the most efficient method for each website
• **NEW**: Puppeteer instance pool for efficient browser reuse and reduced memory usage
• Python 3.9+
• FastAPI
• Pyppeteer for JavaScript-heavy web scraping
• Pyppeteer-stealth for avoiding detection during web scraping
• Puppeteer instance pool for efficient browser reuse
• DuckDuckGo Search API
• BeautifulSoup for HTML parsing
• scikit-learn for TF-IDF based resource relevance filtering
• yt-dlp for YouTube video search and metadata extraction
• Redis (optional) for distributed caching
• msgpack for efficient data serialization
• cachetools for advanced in-memory caching
• Clone the repository:
• Create a virtual environment:
• Install Python dependencies:
• Install Node.js dependencies (for the optimized scraping system):
• Install Chrome/Chromium for Pyppeteer (if not already installed)
• Start the server using the provided batch file (Windows):
• Access the API at `http://localhost:8000`
• Generate an MCP by making a GET request to:
• Check the API documentation at `http://localhost:8000/docs`
• Make a first request to generate an MCP (this will populate the cache):
• Make a second request with the same parameters (this should use the cache):
• [API Reference](docs/api_reference.md) - Detailed API documentation
• [Endpoints Reference](docs/endpoints_reference.md) - Complete reference of all endpoints
• [Flutter Integration](docs/flutter_integration.md) - Guide for integrating with Flutter apps
• [Async Tasks System](docs/async_tasks_system.md) - Documentation for the asynchronous task system
• [Performance Improvements](docs/performance_improvements.md) - Overview of performance optimizations
• [Caching System](docs/caching_system.md) - Documentation for the caching system
• [Web Scraping Optimization](docs/web_scraping_optimization.md) - Details on web scraping optimizations
• `GET /health` - Health check endpoint
• `GET /generate_mcp?topic={topic}&max_resources={max_resources}&num_nodes={num_nodes}&min_width={min_width}&max_width={max_width}&min_height={min_height}&max_height={max_height}&language={language}&category={category}` - Generate an MCP for the specified topic synchronously
• `topic` (required): The topic to generate an MCP for (minimum 3 characters)
• `max_resources` (optional): Maximum number of resources to include (default: 15, min: 5, max: 30)
• `num_nodes` (optional): Number of nodes to include in the learning path (default: 15, min: 10, max: 30)
• `min_width` (optional): Minimum width of the tree (nodes at first level) (default: 3, min: 2, max: 10)
• `max_width` (optional): Maximum width at any level of the tree (default: 5, min: 3, max: 15)
• `min_height` (optional): Minimum height of the tree (depth) (default: 3, min: 2, max: 8)
• `max_height` (optional): Maximum height of the tree (depth) (default: 7, min: 3, max: 12)
• `language` (optional): Language for resources (default: "pt")
• `category` (optional): Category for the topic (e.g., "technology", "finance", "health"). If not provided, it will be detected automatically.
• `POST /generate_mcp_async?topic={topic}&max_resources={max_resources}&num_nodes={num_nodes}&min_width={min_width}&max_width={max_width}&min_height={min_height}&max_height={max_height}&language={language}&category={category}` - Start asynchronous generation of an MCP
• `GET /status/{task_id}` - Check the status of an asynchronous task
• `GET /tasks` - List all tasks
• `POST /clear_cache?pattern={pattern}&clear_domain_cache={clear_domain_cache}` - Clear the cache based on a pattern
• `pattern` (optional): Pattern to match cache keys (default: "\*" for all)
• `clear_domain_cache` (optional): Whether to also clear the domain method cache (default: false)
• `GET /cache_stats` - Get statistics about the cache, including information about the domain method cache
• **Caching System**: Results are cached to improve response times for repeated queries
• **Asynchronous Task System**: Long-running operations are handled asynchronously
• **Resource Filtering**: TF-IDF based filtering to select the most relevant resources
• **Optimized Web Scraping**: Efficient web scraping techniques to reduce resource usage
• **Adaptive Scraping System**: Automatically chooses the most efficient scraping method for each website
• **Puppeteer Instance Pool**: Reuses browser instances to reduce memory usage and startup time
• **Domain Method Cache**: Remembers which scraping method works best for each domain
• **Resource Blocking**: Blocks unnecessary resources (images, stylesheets, fonts) during scraping
• **60-80% reduction in response time** for topics already in cache
• **30-50% reduction in response time** for new topics
• **40-60% reduction in memory usage** during web scraping
• **3-5x increase in throughput** for simultaneous requests