BMEG-ETL is a project that defines the transformers for BMEG. The schema is described here: https://github.com/bmeg/bmeg-dictionary
Install go following instructions at https://go.dev/dl/
go install github.com/bmeg/sifter@main
go install github.com/bmeg/lathe@main
conda install -c conda-forge rdkit
conda install -c conda-forge pandas
conda install -c conda-forge pyarrow
conda install -c conda-forge polars
export PATH=$PATH:$HOME/go/bin
Get all files needed for build
lathe run prep.plan
Run build
lathe run build.plan
Lathe can render the DAG of operations using GraphViz
lathe viz build.plan | dot -Tpng -o test.png