[go: up one dir, main page]

Showing 21 open source projects for "php spider"

View related business solutions
  • Gen AI apps are built with MongoDB Atlas Icon
    Gen AI apps are built with MongoDB Atlas

    The database for AI-powered applications.

    MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
    Start Free
  • PageDNA: Web-to-Print eCommerce Software Icon
    PageDNA: Web-to-Print eCommerce Software

    eCommerce for Print, Signs and Fulfillment Trusted by In‑Plants and Commercial Print Leaders

    PageDNA enables successful eCommerce strategies for commercial print sales organizations, internal print shops, and brand owners. PageDNA’s online ordering platform increases print volume while decreasing touch costs for all stakeholders: clientele, print operations, and the organizations they support.
    Learn More
  • 1

    ahCrawler

    A PHP search engine for your website and web analytics tool. GNU GPL3

    ...The spider is a CLI tool and must be added as a cronjob. In a web based backend you can control all data and analyze your data. You can handle multiple websites in the same backend. PHP 7 or 8 + PDO (Mysql/ Sqlite)
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    Crawlab

    Crawlab

    Distributed web crawler admin platform for spiders management

    ...Tasks are scheduled by the task scheduler module in the master node, and received by the task handler module in worker nodes, which executes these tasks in task runners. Task runners are actually processes running spider or crawler programs, and can also send data through gRPC (integrated in SDK) to other data sources, e.g. MongoDB.
    Downloads: 8 This Week
    Last Update:
    See Project
  • 3
    OpenWebSpider
    OpenWebSpider is an Open Source multi-threaded Web Spider (robot, crawler) and search engine with a lot of interesting features!
    Downloads: 2 This Week
    Last Update:
    See Project
  • 4
    This is fuskit A Fusker clone it's a working clone but it needs to optimized for todays technology so please submit your optimized versions so we can make fuskit better
    Downloads: 0 This Week
    Last Update:
    See Project
  • Activate Self-Service Analytics from Your Data Warehouse | Kubit Icon
    Activate Self-Service Analytics from Your Data Warehouse | Kubit

    Unlock the Power of Your Data

    Kubit delivers enterprise-grade customer journey analytics—directly from your existing data warehouse. Enable every team with self-service insights, driving faster, data-driven decisions with minimal engineering overhead or data movement.
    Learn More
  • 5

    SauceWalk Proxy Helper

    Enumeration and automation of file discovery for your sec tools.

    ...Walk.exe iterates through the local files and folders of your target web application (for example a local copy of Wordpress) and generates requests via your favourite proxy (for example burp suite) against a given target url. The remote agent can be used to identify target files and folders on a live system via a PHP script on the target server(ASP/JSP coming soon). The advantage of this tool is that it allows access to files and folders (for example include or plugin folders) which are not usually seen via a spider or crawler to be security tested with traditional tools. The Py version is on its way soon.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    Sitemap Creator is a PHP class which creates XML sitemaps files compatible with the standard sitemaps.org protocol supported by Google and Bing. Features Uses PHPCrawl class to crawl/spider the website and creates URLs set while all PHPCrawl methods and options are accessible through class. Ability to calculate Priority, Frequency and Last-Modified date with variety of options.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7

    PGBuild

    Compile your mobile web pages into mobile aps via build.phonegap.com

    PGbuild is a Phonegap development system that automates the development process by connecting your CMS/web server with the online service [Phonegap Build](http://build.phonegap.com). PGBuild is essentially a web spider that make off-line versions of web pages. The off-line version is zippped and send to the Phonegap Build service. The spider is controlled by a project file that sets the rules for the spider and the options for the phonebap build service. You may create and manage...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    Bigforum
    Bigforum is a free message board in German. Bigforum ist eine kostenlose Foren-Software. Man benötigt keine Vorkenntnisse, die Codes lassen sich leicht bearbeiten und es gibt ständig neue Funktionen.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 9
    Graidle
    Graidle is a project that is proposed to create a web application to generate graph diagrams. There are several classes specialized in generating histograms(horizontal),line(filled) pie and spider charts.
    Downloads: 1 This Week
    Last Update:
    See Project
  • Enterprise Job Scheduling Software Icon
    Enterprise Job Scheduling Software

    Unify Enterprise Job Scheduling for Scale, Visibility, and Control

    Managing your sprawling data center and cloud with disparate native schedulers creates chaos. Achieve unparalleled control and efficiency over your entire IT environment with JAMS job orchestration tools. JAMS provides the singular, centralized platform required to overcome the complexities of disparate native schedulers. Automate, secure, and govern all your workloads, eliminating fragmented control, compliance risks, and operational bottlenecks. JAMS streamlines operations and ensures audit-ready history, transforming your enterprise automation with confidence and precision.
    Learn More
  • 10
    Crawler
    Crawler is a bare-bones spider designed to quickly and effectively build an index of all files and pages on a given Web site as well as the link relationship (both incoming and outgoing) between each page. More open source at https://github.com/fcc.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    NZBGetter is a PHP Script for linux based systems to spider NZB index sites for NZB files matching your predefined search patterns. The script downloads matching NZB files and passes them to your Usenet Reader.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    Sphider is a lightweight web spider and search engine written in PHP, using MySQL as its back end database. It is a great tool for adding search functionality to your web site or building your custom search engine. Sphider is small, easy to set up and...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    WEB-PA is a spider indexing a set of web sites for collecting statistics. It is currently being run on sites of Italian Public Administrations and studies/reports on their WWW standards compliance, but it can serve for a number of purposes.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    An web-based application for active network devices record creation and SNMP management of it.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    It's multi protocol web chat with using modern web technologies such as ajax,css2(3). It also supports connect to IRC(based on SmartIRC) and Jabber Conference and may be will supports some other networks
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Funnel is a project for use on intranets, or selected sites on the Internet to gather together and index information from several different sources and make it available through a sane, usable interface.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    The project is to develop a search engine. The search engine uses a MYSQL DB, and PHP to see the results. The spider that actually works is made with java and only needs the driver to insert the data to the DB.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    The Spider Web Network Xoops Module Team provides modules for the Xoops community written in the PHP coding language. We develop mods and or take existing php script and port it into the Xoops format. High quality mods is our goal.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    OpenAnonymity consists of a module for apache 2.0 Webserver and a framework that enables you to control search engine spider indexing on a word level, contrary to on file level as in Robots exclusion. OA could force Spiders to follow this rules.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20

    Castor : submit spider

    submit an url on multiple search engines

    Castor is a php tool for webmaster to submit an url on multiple search engines or repositories through a web interface.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    phpSitemapNG is a free Google Sitemaps generator written in PHP, but also generates RSS-based, txt-based and HTML-based sitemap files. It will spider your website and can also index the filesystem.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next