OctoSQL is predominantly a CLI tool which lets you query a plethora of databases and file formats using SQL through a unified interface, even do JOINs between them. (Ever needed to join a JSON file with a PostgreSQL table? OctoSQL can help you with that.) OctoSQL is a query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL. At the same time it's an easily extensible full-blown dataflow engine, and you can use it to add a SQL interface to your own applications. OctoSQL supports a bunch of file formats out of the box, but you can additionally install plugins to add support for other databases. You can specify the output format using the --output flag. Available values for it are live_table, batch_table, csv and stream_native. With Go in version >= 1.18 the application can be built from source. This can be achieved by cloning the repository and running go install from the project directory.
Features
- To use databases which are not included in the core of OctoSQL - like PostgreSQL or MySQL - you need to install a plugin. Installing plugins is very easy
- Plugins are grouped into repositories, and potentially have many versions available
- Browsing available and installed plugins is possible through OctoSQL itself
- Some plugins, like the random_data plugin, can be used without any additional configuration
- OctoSQL is statically typed
- Most of the type system is straight-forward and intuitive, similar to what you'd find in other SQL dialects
Project Samples
