Command Line Mastery
We had a CLI tool, written mostly as a bunch of shell scripts, with a ton of available commands that performed all kinds of utility functions related to observability and operations.
It was mostly written by an excellent coworker, and working with it is where I learned to write effective shell scripts. (Thanks to Nathan and shellcheck for this vital... See more
It was mostly written by an excellent coworker, and working with it is where I learned to write effective shell scripts. (Thanks to Nathan and shellcheck for this vital... See more
Bill Mill • notes.billmill.org
dasel
Dasel (short for data-selector) allows you to query and modify data structures using selector strings.
Comparable to jq / yq, but supports JSON, YAML, TOML, XML and CSV with zero runtime dependencies.
One tool to rule them all
Say good bye to learning new tools just to work with a different data format.
Dasel uses a standard selector syntax no m... See more
Dasel (short for data-selector) allows you to query and modify data structures using selector strings.
Comparable to jq / yq, but supports JSON, YAML, TOML, XML and CSV with zero runtime dependencies.
One tool to rule them all
Say good bye to learning new tools just to work with a different data format.
Dasel uses a standard selector syntax no m... See more
Tom Wright • GitHub - TomWright/dasel: Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a...
ETL
The part of the system I'm most proud of, and on which I spent the most effort, is the ETL process.
We had a series of shell scripts for each data source we ingested (there were many), which would pull the data and put it in an s3 bucket.
Then, early in the morning, a cron job would spin up an EC2 instance, which would pull in the latest ETL code... See more
The part of the system I'm most proud of, and on which I spent the most effort, is the ETL process.
We had a series of shell scripts for each data source we ingested (there were many), which would pull the data and put it in an s3 bucket.
Then, early in the morning, a cron job would spin up an EC2 instance, which would pull in the latest ETL code... See more
Bill Mill • notes.billmill.org
xo
xo is a command-line tool to generate idiomatic code for different languages code based on a database schema or a custom query.
Installing | Building | Using | Releases
Supported languages
At the moment, xo only supports Go. Support for other languages will come soon.
How it works
In schema mode, xo connects to your database and generates code usi... See more
xo is a command-line tool to generate idiomatic code for different languages code based on a database schema or a custom query.
Installing | Building | Using | Releases
Supported languages
At the moment, xo only supports Go. Support for other languages will come soon.
How it works
In schema mode, xo connects to your database and generates code usi... See more
kenshaw • GitHub - xo/xo: Command line tool to generate idiomatic Go code for SQL databases supporting PostgreSQL, MySQL, SQLite, Oracle, and Microsoft SQL Server
ShellCheck
finds bugs in your shell scripts.
You can cabal , apt , dnf , pkg or brew install it locally right now.
Paste a script to try it out:
finds bugs in your shell scripts.
You can cabal , apt , dnf , pkg or brew install it locally right now.
Paste a script to try it out:
ShellCheck – shell script analysis tool
Ideas related to this collection