Skip to content

Gooberpatrol66/dgsh

 
 

Repository files navigation

The Directed Graph Shell (dgsh)

Build Status

The directed graph shell, dgsh, allows the expressive expression of efficient big data set and streams processing pipelines using existing Unix tools as well as custom-built components. It is a Unix-style shell allowing the specification of pipelines with non-linear scatter-gather operations. These form a directed acyclic process graph, which is typically executed by multiple processor cores, thus increasing the operation's processing throughput.

You can find a complete introduction, reference documentation, and illustrated examples in the suite's web site.

See also, a quick video overview and the associated (open access) paper, Extending Unix pipelines to DAGs, published in the IEEE Transactions on Computers, 66(9):1547–1561, 2017.

About

Shell supporting pipelines to and from multiple processes

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C 59.4%
  • Shell 24.2%
  • Roff 7.0%
  • HTML 2.7%
  • Makefile 2.1%
  • Java 1.7%
  • Other 2.9%