Open Source Command Line Tools

Duplicati is a free and open source backup client for securely storing your data. Duplicati stores encrypted, incremental, compressed backups on cloud storage services and remote file servers using AES-256 encryption, keeping your data safe and always updated. It works with most storage services, including Google Cloud and Drive, Amazon S3, Microsoft Azure and OneDrive, Dropbox, FTPOpenStack Storage (Swift), SSH (SFTP), WebDAV, Tencent Cloud Object Storage (COS), and more! Duplicati also works on all major platforms (Windows, Linux and OSX). Unlike many other backup solutions, Duplicati ensures that your data is stored securely far away and updated regularly. Incremental updates means it saves on bandwidth and storage space, with a scheduler that automatically keeps your backups up to date.

Dbmate is a database migration tool, to keep your database schema in sync across multiple developers and your production servers. It is a standalone command line tool, which can be used with Go, Node.js, Python, Ruby, PHP, or any other language or framework you are using to write database-backed applications. This is especially helpful if you are writing many services in different languages, and want to maintain some sanity with consistent development tools. Supports MySQL, PostgreSQL, SQLite, and ClickHouse. Uses plain SQL for writing schema migrations. Migrations are timestamp-versioned, to avoid version number conflicts with multiple developers. Migrations are run atomically inside a transaction. Supports creating and dropping databases (handy in development/test). Supports saving a schema.sql file to easily diff schema changes in git. Database connection URL is defined using an environment variable (DATABASE_URL by default), or specified on the command line.

jdbc2csv is a small command-line tool written in JAVA and can be used on all platforms, for which JRE 8 or higher is available. To connect to a specific DBMS the tool uses its JDBC driver. The result of the executed 'select' query is displayed in CSV format ( different standards are supported ). When there is an error the tool stops with exit code 1 and the error message is output on stderr. jdbc2csv is created with a main purpose to be used in shell-scripts. Relatively easy to configurate, this tool is suitable for queries ‘select’, ‘update’ and ‘delete’. I think that is not suitable for a large number of requests, like 'insert'.

Apple has a utility in /usr/bin named tccutil, but it only supports one command, which is to reset the entire database. It has been like this for many versions of macOS. I wanted a command-line utility that would be able to add, remove, list, and take other actions. This tool needs SIP disabled in order to function. The risk of doing so is up to you. tccutil.py can be installed without any additional software. Depending how you have your $PATH variable setup, you can simply type tccutil (instead of the full path) and it will run this utility instead of Apple's. This utility needs super-user priveleges for most operations. It is important that you either run this as root or use sudo, otherwise it won't work and you will end up with “permission denied” errors.

Jisql is a Java based utility to provide a command line interactive session with a SQL server. It can connect to any database with a JDBC driver.

CRGREP searches for matching text in databases, various document formats, archives and other difficult to access resources. A command line tool for name and content text matching in database tables, plain files, MS Office documents, PDF, archives, MP3 audio, image meta-data, scanned documents, maven dependencies and web resources. CRGREP will search resources within resources of any arbitrary combination or depth, so text within a document within a zip archive, and so on. Here you will find binary downloads and discussion (https://sourceforge.net/p/crgrep/discussion/) . The actual development and issue tracking can be found here: https://bitbucket.org/cryanfuse/crgrep

dbf is an easy-to-use command line tool to show and convert the content of dBASE III, IV, and 5.0 files. It reads dBASE databases and prints the content to the screen or converts it to comma-separated (*.csv) files which can be opened in Excel, Calc.

This tiny tool reads a database in the Clarion Database format and converts it to CSV format. It is a command-line tool and designed to work in Linxu, although the configure may work right under other operating systems as well, like MinGW.

Jdbsee CLI supports running SQL queries from command line in batch or interactive mode. Database connection settings and related credentials can be persisted for later reuse. The JDBC drivers can be automatically downloaded from maven central repo or loaded from local jars. For more info see https://github.com/davidecavestro/jdbsee/blob/master/docs/index.adoc.

A graphical and command line tool for comparing database tables. The comparison is displayed as html. This tool would likely be used to compare a test database table to a production database table.

Java command line tool for calculating the complexity of a database model using the Small Worlds Data Transformation Measure.

DataBaseMerge is a command line tool, that merges database structures.

NOAHDB is a command line tool that parses the log files that are emitted by the Argos Honeypot and populates the tables of a MySQL database.

Small command line tool to directly execute SQL statements against any OleDB database. Can also execute a sql batch file. Handy for automation purposes e.g. for MS Access databases.

Command-line tool lets you copy table data from Oracle to SQLServer database. Touch and go design.

PgWorksheet is a simple GUI frontend to PostgreSQL for executing SQL queries and psql commands without using the psql command line tool. Please see the project home page for bug reports, forums and installation instructions.

A command line tool to generate report output from JasperReports report definition files (.jrxml files) such as those generated by iReport, by running them against a live database. Output PDF/HTML is written to disk and can optionally be emailed.

This is a command-line tool, written in perl, that will convert from any database supported by perl DBI that also supports the information_schema standard to a MySQL database. It was written to convert from SQL Server to MySQL.

This tool provides User Interface for command-line tool SqlMetal which can generate code and mapping for the LINQ to SQL component of the .NET Framework.

Z-SQL is a package-oriented SQL language designed for Microsoft SQL Server. Full language specification is provided. The compiler translates Z-SQL to SQL Server's native T-SQL. A command line tool, zsql, that superseeds osql is also included.

omnimysql is a command line tool for DBAs needing to issue ad-hoc queries against sharded data.

Command line tool for syncronize heterogeneous databases. Work via QT4 drivers (Drivers for SQLite, QDBC, Firebird are included. Drivers for IBase, DB2, Postgeress, Mysql may be compilled by Qt4 (4.7.0 for 0.0.4)))

Provides a linux/unix command line tool to "scrub" comma delimited files. Removing extra spaces, mr. dr. etc. Also removing duplicate records based on a comparison of columns/fields. It's a bash script using awk, cut, join and nl. Using a little perl