[go: up one dir, main page]

Showing 248 open source projects for "duplicate text remove"

View related business solutions
  • Gen AI apps are built with MongoDB Atlas Icon
    Gen AI apps are built with MongoDB Atlas

    The database for AI-powered applications.

    MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
    Start Free
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 1
    Text Line Duplicate Remover

    Text Line Duplicate Remover

    Remove duplicate lines from your text

    This standalone offline web browser tool helps you remove duplicate lines from your text, with additional text processing options. Simply open it in your browser by double-clicking the html file. It also includes the source code too. I made this when I was working with long lists of entries and needed something to automatically clean them up. As a bonus you can also change the Sentence Case of the text, make it lowercase, UPPERCASE or Sentence case.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 2
    text-dedup

    text-dedup

    All-in-one text de-duplication

    text-dedup is a Python library that enables efficient deduplication of large text corpora by using MinHash and other probabilistic techniques to detect near-duplicate content. This is especially useful for NLP tasks where duplicated training data can skew model performance. text-dedup scales to billions of documents and offers tools for chunking, hashing, and comparing text efficiently with low memory usage. It supports Jaccard similarity thresholding, parallel execution, and flexible...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    Video-subtitle-extractor

    Video-subtitle-extractor

    A GUI tool for extracting hard-coded subtitle (hardsub) from videos

    ... and Ali to complete text recognition locally. Support GPU acceleration, after GPU acceleration, you can get higher accuracy and faster extraction speed. (CLI version) No need for users to manually set the subtitle area, the project automatically detects the subtitle area through the text detection model. Filter the text in the non-subtitle area and remove the watermark (station logo) text.
    Downloads: 73 This Week
    Last Update:
    See Project
  • 4
    DiscordBotClient

    DiscordBotClient

    A patched version of discord, with bot login support

    A patched version of Discord, with bot login support. Discord Bot Client allows you to use your bot, just like any other user account, except for Friends and Groups.
    Downloads: 88 This Week
    Last Update:
    See Project
  • Simple, Secure Domain Registration Icon
    Simple, Secure Domain Registration

    Get your domain at wholesale price. Cloudflare offers simple, secure registration with no markups, plus free DNS, CDN, and SSL integration.

    Register or renew your domain and pay only what we pay. No markups, hidden fees, or surprise add-ons. Choose from over 400 TLDs (.com, .ai, .dev). Every domain is integrated with Cloudflare's industry-leading DNS, CDN, and free SSL to make your site faster and more secure. Simple, secure, at-cost domain registration.
    Sign up for free
  • 5
    Grabber

    Grabber

    Very customizable imageboard/booru downloader with powerful filenaming

    Very customizable imageboard/booru browser and mass downloader, with powerful file naming features. Thanks to its powerful naming features, you just have to set your filename and save the directory using all the tokens available, and the program will generate a filename using the image's information. With this, you can store and manage your pictures in advanced directory structures, and save images with custom filenames. Imageboard/booru downloader which can download thousands of images from...
    Downloads: 25 This Week
    Last Update:
    See Project
  • 6
    SingleFile

    SingleFile

    Web Extension for Firefox/Chrome/MS Edge and CLI tool

    Web Extension for Firefox/Chrome/MS Edge and CLI tool to save a faithful copy of an entire web page in a single HTML file. SingleFile is a Web Extension (and a CLI tool) compatible with Chrome, Firefox (Desktop and Mobile), Microsoft Edge, Vivaldi, Brave, Waterfox, Yandex Browser, and Opera. It helps you to save a complete web page into a single HTML file. Wait until the page is fully loaded. Click on the SingleFile button in the extension toolbar to save the page. You can click again on the...
    Downloads: 16 This Week
    Last Update:
    See Project
  • 7
    Screenity

    Screenity

    The most powerful screen recorder & annotation tool for Chrome

    Screenity is a feature-packed screen and camera recorder for Chrome. Annotate your screen to give feedback, emphasize your clicks, edit your recording, and much more. Make unlimited recordings of your tab, desktop, any application, and camera. Annotate by drawing anywhere on the screen, adding text, and creating arrows. Highlight your clicks, focus on your mouse, or hide it from the recording. Individual microphone and computer audio controls, push to talk, and more. Custom countdowns, show...
    Downloads: 5 This Week
    Last Update:
    See Project
  • 8
    Meta Package Manager

    Meta Package Manager

    Wraps all package managers with a unifying CLI

    Meta Package Manager wraps all package managers with a unifying CLI, and provides the MPM CLI, a wrapper around all package managers. MPM is like yt-dlp, but for package managers instead of videos. MPM solves XKCD #1654 - Universal Install Script. List installed packages. List duplicate installed packages. Search for packages. Install a package, remove a package, and list outdated packages. Sync local package infos. Upgrade all outdated packages. Backup list of installed packages to TOML file...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 9
    ngx-quill

    ngx-quill

    Angular components for the Quill Rich Text Editor

    ngx-quill is an angular (>=2) module for the Quill Rich Text Editor containing all components you need. It is possible to set custom default modules and Quill config options with the import of the QuillModule.forRoot(). Use <quill-editor></quill-editor> in your templates to add a default quill editor. Do not forget to include quill + theme CSS in your build process, module or index.html! For builds with angular-cli >=6 only add quilljs to your scripts or scripts section of angular.json, if you...
    Downloads: 2 This Week
    Last Update:
    See Project
  • DataHub is the leading open-source data catalog helping teams discover, understand, and govern their data assets. Icon
    DataHub is the leading open-source data catalog helping teams discover, understand, and govern their data assets.

    Modern Data Catalog and Metadata Platform

    Built on an open source foundation with a thriving community of 13,000+ members, DataHub gives you unmatched flexibility to customize and extend without vendor lock-in. DataHub Cloud is a modern metadata platform with REST and GraphQL APIs that optimize performance for complex queries, essential for AI-ready data management and ML lifecycle support.
    Learn More
  • 10
    duf

    duf

    Disk usage and free utility, a better 'df' alternative

    ..., duplicate, inaccessible file systems), you can. You can show and hide specific tables. You can also show and hide specific filesystems. List inode information instead of block usage. If duf doesn't detect your terminal's colors correctly, you can set a theme. Users of oh-my-zsh should be aware that it already defines an alias called duf, which you will have to remove in order to use duf.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 11
    KrakenD

    KrakenD

    High-performance, stateless, declarative, API Gateway written in Go.

    KrakenD is more than a typical proxy that forwards clients to backend services, but a powerful engine that can transform, aggregate or remove data from your own or third party services. KrakenD also implements the Backend for Frontend and Micro-frontends patterns to eliminate the necessity of dealing with multiple REST services, isolating clients from the micro-service implementation details. KrakenD's stateless architecture and performance-first approach for every internal component beat any...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 12
    SurveyJS

    SurveyJS

    JavaScript Survey and Form Library

    SurveyJS Form Library is distributed as npm packages and as scripts and style sheets that you can reference on your page. You can use it in any React, Angular, Vue, Knockout, or jQuery application. React, Angular, Knockout, and Vue3 are supported natively. To communicate with the server, the libraries use JSON objects that represent form schemas (content and layout of a form) and form results (answers). You have the option to build dynamic JSON-driven forms using our free full-featured...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 13
    kubectl-neat

    kubectl-neat

    Clean up Kubernetes yaml and json output to make it readable

    Remove clutter from Kubernetes manifests to make them more readable.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    OpenDetex

    OpenDetex

    Tool for extracting plain text from TeX and LaTeX sources

    Improved version of Detex, tool for extracting plain text from TeX and LaTeX sources. OpenDetex is a program to remove TeX constructs from a text file. It recognizes the \input command. This program assumes it is dealing with LaTeX input if it sees the string "\begin{document}" in the text. It recognizes the \include and \includeonly commands.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    Actions

    Actions

    Supercharge your shortcuts

    The app provides lots of powerful extra actions for the Shortcuts app on macOS and iOS. These actions make it significantly easier to create shortcuts. Want to run shortcuts directly from the iOS Lock Screen? Check out my Quick Launch app. And trigger shortcuts on your Mac from your iOS device with my Hyperduck app. And for high-quality transcription, see my Aiko app.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    vim-go

    vim-go

    Go development plugin for Vim

    This plugin adds Go language support for Vim, with the following main features. Look up documentation with :GoDoc or :GoDocBrowser, easily import packages via :GoImport, remove them via :GoDrop. Precise type-safe renaming of identifiers with :GoRename. See which code is covered by tests with :GoCoverage. Add or remove tags on struct fields with :GoAddTags and :GoRemoveTags. Call golangci-lint with :GoMetaLinter to invoke all possible linters (golint, vet, errcheck, deadcode, etc.) and put...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    flag-icons

    flag-icons

    A curated collection of all country flags in SVG

    A curated collection of all country flags in SVG, plus the CSS for easier integration. For using the flags inline with text add the classes .fi and .fi-xx (where xx is the ISO 3166-1-alpha-2 code of a country) to an empty <span>. If you want to have a squared version flag then add the class fis as well. You could also apply this to any element, but in that case you'll have to use the fib instead of fi and you're set. This means that the flag is just going to appear in the middle of an element...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    OpenSCAD Graph Editor

    OpenSCAD Graph Editor

    OpenSCAD Graph Editor

    OpenSCAD Graph Editor is a graphical user interface for OpenSCAD that allows you to create 3D models by connecting nodes in a graph. The editor will automatically generate OpenSCAD code for you. It integrates with the OpenSCAD program so you can preview your models in real-time while you are editing the graph. Please check the manual to find out how to install and use the program.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    DeepDetect

    DeepDetect

    Deep Learning API and Server in C++14 support for Caffe, PyTorch

    The core idea is to remove the error sources and difficulties of Deep Learning applications by providing a safe haven of commoditized practices, all available as a single core. While the Open Source Deep Learning Server is the core element, with REST API, and multi-platform support that allows training & inference everywhere, the Deep Learning Platform allows higher level management for training neural network models and using them as if they were simple code snippets. Ready for applications...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Krajee

    Krajee

    An enhanced HTML 5 file input for Bootstrap 5.x/4.x./3.x

    An enhanced HTML 5 file input for Bootstrap 5.x or Bootstrap 4.x or Bootstrap 3.x with file preview for various files, offers multiple selection, and more. The plugin allows you a simple way to setup an advanced file picker/upload control built to work specially with Bootstrap CSS3 styles. It enhances the file input functionality further, by offering support to preview a wide variety of files i.e. images, text, html, video, audio, flash, and objects. In addition, it includes AJAX based uploads...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    Remove Duplicate Lines

    Remove Duplicate Lines

    Remove duplicate lines in text file

    A handy tool with graphical interface that remove/delete duplicate lines in a text file. GitHub source: https://github.com/ahmed-fathy/remove-duplicates/
    Downloads: 6 This Week
    Last Update:
    See Project
  • 22
    Vimium C

    Vimium C

    A keyboard shortcut browser extension for keyboard-based navigation

    ... page). And it can map the same key sequence to different commands for different websites (and/or for different active elements on the page). It can copy any selected text and current tab's title and URL to the system clipboard, and read the clipboard to search the copied text using a specified search engine. It can also enable/disable websites' image loading and even JavaScript execution, if you trigger its command "toggleCS".
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    Swiss File Knife

    Swiss File Knife

    One hundred command line tools in a small and portable binary.

    Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find...
    Leader badge">
    Downloads: 630 This Week
    Last Update:
    See Project
  • 24
    jEdit Plugin Central is the primary online repository of plugins for the jEdit text editor. In conjunction with this repository, the integrated Plugin Manager allows jEdit users to install, upgrade, and remove plugins without leaving the editor.
    Leader badge">
    Downloads: 1,783 This Week
    Last Update:
    See Project
  • 25
    vConsole

    vConsole

    A lightweight, extendable front-end developer tool for mobile web page

    ... development. You can destroy an vConsole instance object and remove vConsole panel from document. You can also add a new plugin to vConsole. Duplicate plugin will be ignored. Create an vConsole plugin object, bind plugin events to this object, and add this object to vConsole. While installing and running a plugin, vConsole will trigger some events to allow a plugin customizing it's functions.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • 2
  • 3
  • 4
  • 5
  • Next