Search Results for "web crawler source code"
Sort By:
Showing 228 open source projects for "web crawler source code"
View related business solutions-
Gen AI apps are built with MongoDB AtlasMongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
-
We help you deliver Virtual and Hybrid Events using our Award Winning end-to-end Event Management PlatformEventsAIR have been anticipating and responding to the ever-changing event industry needs for over 30 years, providing innovative solutions that empower event organizers to create successful events around the globe.
-
1
Open QR Code
Open QR Code is an open-source, cross-platform app
Open QR Code is an open-source cross-platform application developed using Flutter as main framework used to build the application, in common C, C++, Dart, Skia (a 2D rendering engine), and Impeller (the default rendering engine on iOS), Java, Kotlin. Open QR Code allows users to generate and scan QR codes effortlessly. The app is available on Android, Windows, and the Web. -
2
miniblink49
Lighter, faster browser kernel of blink to integrate HTML UI in apps
miniblink is an open source, one file, small browser widget based on chromium. By using C interface, you can create a browser with just some line code. miniblink is an open source, single-file, and currently the smallest known chromium-based browser control. Through its exported pure C interface, a browser control can be created in a few lines of code. C++, C#, Delphi and other language calls (support C++, C#, Delphi language to call). -
3
ModSecurity
Cross platform web application firewall (WAF) engine for Apache
ModSecurity is an open-source, cross-platform web application firewall (WAF) engine for Apache, IIS and Nginx that is developed by Trustwave's SpiderLabs. It has a robust event-based programming language that provides protection from a range of attacks against web applications and allows for HTTP traffic monitoring, logging and real-time analysis. Libmodsecurity is one component of the ModSecurity v3 project. The library codebase serves as an interface to ModSecurity Connectors taking in web... -
4
Floorp Browser
All of source code of version 10 or later of Floorp Browser
...Floorp will be updated every 4 weeks, with security updates provided before each Firefox release. We don't collect personal information from users. We don't track users. We don't sell user data. We have no affiliation with any advertising companies. Floorp's source code is entirely open, allowing anyone to view it and contribute to the project. Not only is the browser itself open source, but the build environment is as well. -
viewneo - Smart software for digital advertising boardsviewneo is a user-friendly, cloud-based solution that allows companies of all sizes to set up digital signage
-
5
RobotsTxt
The repository contains Google's robots.txt parser
This is a high-performance, production-tested library for parsing and evaluating robots.txt rules against crawler user agents. It implements the core semantics of the Robots Exclusion Protocol: user-agent sections, Allow/Disallow directives, wildcard handling, and precedence rules. The code is optimized for speed and low memory so large crawls can evaluate millions of URLs quickly. It also focuses on correctness—edge cases like overlapping patterns and longest-match resolution are handled... -
6
Cutelyst
Web Framework built on top of Qt, using the approach of Catalyst
Create fast and modern web applications that share the same code as your desktop or mobile apps. Why have two or more development teams focused on a specific platform when you can have a single team coding the same code, sharing skills and lines of code. With Qt, you already can write applications for Windows, Linux, Android, MacOS, and iOS using the same source code, Cutelyst allows you to share your C++ code with your web application. ... -
7
Emscripten
Emscripten: An LLVM-to-WebAssembly Compiler
Emscripten is a complete open-source compiler toolchain that transforms C, C++, and other LLVM-based source code into WebAssembly (and JavaScript), enabling native‑like applications to run in web browsers, Node.js, and other Wasm environments. While Emscripten mostly focuses on compiling C and C++ using Clang, it can be integrated with other LLVM-using compilers (for example, Rust has Emscripten integration, with the wasm32-unknown-emscripten and asmjs-unknown-emscripten targets). ... -
8
Oat++
Light and powerful C++ web framework for web applications
Oat++ has zero dependencies and it's easily portable with a wide range of supported platforms. With Oat++ Simple-API it's easy and fun to build flexible and robust APIs. With Oat++ Async-API you can handle over 5 Million concurrent connections on a single server. Oat++ ORM provides an easy and unified way to access databases. Oat++ relies on Object-Mapping throughout its codebase to ensure consistency of APIs and data models. Automatically document endpoints with Swagger-UI and OpenAPI... -
9
Hello ImGui
Hello, Dear ImGui: unleash your creativity in app development
hello_imgui is a cross-platform framework that simplifies the development of graphical applications using Dear ImGui. It abstracts away boilerplate code for window creation, input handling, and platform integration, allowing developers to focus on building user interfaces and interactive content quickly. Targeted at prototyping, tools, and GUI apps, hello_imgui works on Windows, macOS, Linux, iOS, and WebAssembly with minimal setup. Its plug-and-play nature makes it ideal for teaching,... -
The most advanced C and C++ source code analyzerTrustInSoft Analyzer is a C and C++ source code analyzer powered by formal methods, mathematical & logical reasonings that allow for exhaustive analysis of source code. This analysis can be run without false positives or false negatives, so that every real bug in the code is found. Developers receive several benefits: a user-friendly graphical interface that directs developers to the root cause of bugs, and instant utility to expand the coverage of their existing tests. Unlike traditional source code analysis tools, TrustInSoft’s solution is not only the most comprehensive approach on the market but is also progressive, instantly deployable by developers, even if they lack experience with formal methods, from exhaustive analysis up to a functional proof that the software developed meets specifications.
-
10
Defold
Free game engine for development of desktop, mobile, and web games
Defold is an open-source, cross-platform game engine originally developed for 2D games but also capable of 3D — intended to give developers a turnkey solution for building games for desktop, mobile, web, and even consoles. It ships as a full editor/IDE, combining scene editing, asset management, scripting, and build/export pipelines, so developers don’t need to assemble disparate tools themselves. -
11
Play!
Play! - PlayStation2 Emulator
Play! is an open-source cross-platform emulator for Sony’s PlayStation 2 that aims to run PS2 games on a wide range of modern systems including Windows, macOS, Linux, Android, iOS, and web browsers by implementing core PS2 hardware functionality in software. It emulates primary components like the Emotion Engine CPU and graphics synthesizer, translating game code and hardware calls into host system operations, while providing users with controls to load disc images, manage states, and configure rendering options. ... -
12
BrowserOS
Agentic browser; privacy-first alternative to ChatGPT Atlas
BrowserOS is an open-source, agentic web browser built on a Chromium base that integrates AI agents directly into the browsing experience. Rather than just doing standard browsing, it places AI intelligence at the core: you can connect your own API keys (for e.g., OpenAI, Anthropic, Google Gemini) or run local models (via e.g., Ollama) so that your browsing data and automation stay on your machine — privacy and control are emphasized throughout. The interface remains familiar to users of... -
13
workerd
The JavaScript / Wasm runtime that powers Cloudflare Workers
workerd is the server runtime that powers Cloudflare Workers — a modern, standards-aligned JavaScript and WebAssembly execution environment that can be run outside of Cloudflare’s global edge network as a standalone server or proxy. Designed to host serverless applications written to the Workers platform API (including fetch() and Web standard libraries), workerd enables developers to self-host edge-style workloads in local data centers or development environments, or to test Workers code... -
14
HUSTOJ
Popular Open Source Online Judge based on PHP/C++/MySQL/Linux
Popular Open Source Online Judge based on PHP/C++/MySQL/Linux for ACM/ICPC and NOIP training, with easy installation. Open source OJ system. HUSTOJ is free software under the GPL. (Only the original part of the code, which uses components from other open-source projects, please follow the agreement of the original component.) Because the web terminal/database/judgment machine are all packaged in the same image and cannot be extended, it is not recommended to use this image for distributed judgment. ... -
15
TreeFrog Framework
TreeFrog Framework, High-speed C++ MVC Framework for Web Applications
...TreeFrog Framework is cross-platform. It runs on Windows, of course, but also on UNIX-like Operating Systems, macOS, and Linux. Using Windows open-source coding, it is possible to support Linux. Web applications that run on multiple platforms are also possible, simply by recompiling the source code. TreeFrog Framework is open-source software, under the new BSD license (3-clause BSD License). -
16
YueScript
A Moonscript dialect compiles to Lua
A language that compiles to Lua. Yuescript is a Moonscript dialect. It is derived from Moonscript language 0.5.0 and continuously adopts new features to be more up-to-date. Moonscript is a language that compiles Lua. Since the original Moonscript has been used to write web framework lapis and run a few business websites like itch.io and streak.club with some large code bases. The original language is getting too hard to adopt new features for those that may break the stability of existing... -
17
WasmEdge
Extensible WebAssembly runtime for cloud native applications
WasmEdge is a lightweight, high-performance, and extensible WebAssembly runtime. It is the fastest Wasm VM today. WasmEdge is an official sandbox project hosted by the CNCF. Its use cases include modern web application architectures (Isomorphic & Jamstack applications), microservices on the edge cloud, serverless SaaS APIs, embedded functions, smart contracts, and smart devices. The WasmEdge Runtime provides a well-defined execution sandbox for its contained WebAssembly bytecode program. The... -
18
React Native for Windows
A framework for building native Windows apps with React
Bring your React Native apps to some of the most powerful devices out there. Take your apps across PC, Xbox, Surface Tablets, and dual-screens with our robust Windows extension to React Native. Extend your desktop experience to more than just Windows! Try out our fully supported macOS extension to React Native. React Native for Windows + macOS brings React Native support for the Windows 10 SDK as well as the macOS 10.13 SDK. With this, you can use JavaScript to build native Windows apps for... -
19
Skiko
Kotlin Multiplatform bindings to Skia
Skiko is an open-source graphics library from JetBrains that provides lightweight, cross-platform bindings for the Skia graphics engine tailored specifically for Kotlin Multiplatform and Compose applications. It serves as the low-level rendering backbone for Kotlin UI frameworks like Compose for Desktop and Compose for Web, enabling smooth, GPU-accelerated 2D graphics across Windows, macOS, Linux, and other supported targets without writing native code. -
20
DeepDetect
Deep Learning API and Server in C++14 support for Caffe, PyTorch
The core idea is to remove the error sources and difficulties of Deep Learning applications by providing a safe haven of commoditized practices, all available as a single core. While the Open Source Deep Learning Server is the core element, with REST API, and multi-platform support that allows training & inference everywhere, the Deep Learning Platform allows higher level management for training neural network models and using them as if they were simple code snippets. Ready for applications... -
21
WallPaper (alias crawlpaper) is a desktop changer (NOT a screensaver) which includes a web crawler for picture download, an audio stream ripper, an audio player, a mini mp3 tag editor,etc. Also included support for .zip and .rar files and an interface to the BerkleyDB code for small databases.
-
22
gSOAP Toolkit
Development toolkit for Web Services and XML data bindings for C & C++
The gSOAP toolkit is an extensive suite of portable C and C++ software to develop XML Web services with powerful type-safe XML data bindings. Easy-to-use code-generator tools allow you to directly integrate XML data in C and C++. Serializes native application data in XML. Includes WSDL/XSD schema binding and auto-coding tools, stub/skeleton compiler, Web server integration with Apache module and IIS extension, high-performance XML processing with schema validation, fast MIME/MTOM streaming,...">
-
23
Audacity
A free multi-track audio editor and recorder
...Audacity is free software, developed by a group of volunteers and distributed under the GNU General Public License (GPL). Programs like Audacity are also called open source software, because their source code is available for anyone to study or use. There are thousands of other free and open source programs, including the Firefox web browser, the LibreOffice or Apache OpenOffice office suites and entire Linux-based operating systems such as Ubuntu -
24
BinaryPHP is a PHP To C++ converter which will convert PHP scripts into C++ equivalents ready to be compiled using any ANSI compiler.
-
25
Ring
Simple and flexible programming language for applications development
The Ring is a practical general-purpose multi-paradigm language. The supported programming paradigms are imperative, procedural, object-oriented, declarative using nested structures, functional, meta programming and natural programming. The language is portable (MS-DOS, Windows, Linux, macOS, Android, WebAssembly, Microcontrollers, etc.) and can be used to create Console, GUI, Web, Games and Mobile applications. The language is designed to be simple, small and flexible. Ring is...