Popular repositories Loading

1. gcp-batch-ingestion-bigquery gcp-batch-ingestion-bigquery Public

   Forked from polleyg/gcp-batch-ingestion-bigquery

   Uses Cloud Build to deploy a scalable batch ingestion pipeline consisting of GCS, Cloud Functions, Dataflow and BigQuery

   Java

2. gcp-bigquery-table-to-one-file gcp-bigquery-table-to-one-file Public

   Forked from polleyg/gcp-bigquery-table-to-one-file

   Using Cloud Dataflow, read a table in BigQuery, and turns it into one file in GCS (BigQuery only support sharded exports over 1GB).

   Java

3. gcp-tweets-streaming-pipeline gcp-tweets-streaming-pipeline Public

   Forked from polleyg/gcp-tweets-streaming-pipeline

   Twitter -> App Engine Flex -> PubSub -> Dataflow -> BigQuery

   Python

4. gcp-dataflow-copy-bigquery gcp-dataflow-copy-bigquery Public

   Forked from polleyg/gcp-dataflow-copy-bigquery

   An application that uses Cloud Dataflow and Cloud Build to copy/transfer BigQuery tables between locations/regions.

   Java

5. gcp-auto-dlp-scan-bigquery gcp-auto-dlp-scan-bigquery Public

   Forked from polleyg/gcp-auto-dlp-scan-bigquery

   An application that monitors new tables added to BigQuery and triggers a DLP when a new table is detected

   Python

6. computering-aphorisms computering-aphorisms Public

   Forked from polleyg/computering-aphorisms

   Some things I wish I'd known before starting my computering career