1.5.4

This is a patch release with feature and bug fixes.

What's Changed

Feature enhancements:
[FEATURE] Implement pulling release version from environment file
[FEATURE] Implement SSL for web service in AWS EC2
[FEATURE] Improve collect_logs.sh script
[FEATURE] Implement alerting for project health monitoring

Bug Fixes:
[BUG #278] (CRITICAL) web_scraper scrapes only first page and is not scraping other 2 pages
[BUG #267] DB container keep logging FATAL: database "new_docker_user" does not exist
[BUG #263] CI fails build step to pull web image
[BUG #261] docker-compose file does not contain web service

1.5.3

This is a patch release with feature and bug fixes.

What's Changed

Feature enhancements:
[FEATURE ] Pygwalker In Streamlit data explorer is publicly available

Bug Fixes:
[BUG #257] Fix default web port blocked by Fastapi ws
[BUG #249] Fix missing encoding when open used

1.4.12

This is a patch release with many small new features and bug fixes.

What's Changed

Feature enhancements:

• [FEATURE #211] Add basic Streamlit SQL explorer
• [FEATURE #214] Add more reliable file move handling
• [FEATURE #196] Add timeouts in task_schedule module
• [FEATURE #187] Add missing AWS lambda scrape job result file usage logic in web scraper module
• [FEATURE #228] Add advert count inserted in each date from currently listed ads table enhancement
• [FEATURE #228] Add advert count inserted per each date from currently listed ads table
• [FEATURE #236] Add in email body daily removed and listed adds enhancement
• [FEATURE #238] Add more verbose add count tracking wen data is inserted in DB

Bug Fixes:

• [BUG #147] Fix error after first scrape job completed for cases when DB backup is not imported
• [BUG #191] Remove add tasks to background
• [BUG #194] Change scrape job start time
• [BUG #193] Fix scrape job not triggered after CICD
• [BUG #220] Fix incorrect handling of division by zero in web_scarper module
• [BUG #222] Fix issue when email body does not contain data
• [BUG #225] Fix issue when basic price stats content is not valid
• [BUG #230] Fix issue when email body is missing data and links
• [BUG #232] fix issue when Postgres DB container does not store data in persistent volume

1.4.9

This is a minor patch with a new feature.

What's Changed

Feature enhancements:

• [FEATURE #198] Added CICD Github action workflow to deploy to AWS EC2

1.4.8

This is a patch release with few small feature enhancements.

What's Changed

Feature enhancements:

• [FEATURE #155] Add uniq email title to improving application debugging
• [FEATURE #158] Add functionality to extract data from DB removed_ads table
• [FEATURE #159] Add ability to save extracted removed_ads data to file

1.4.7

This is a patch release with few new features and bug fixes.

What's Changed

• [BUG #100] Reduce task_scheduler module check event count
• [BUG #113] FIx missing plots in reports file
• [BUG #118] Fix missing file copy
• [BUG #130] Fix issue when new csv file is loaded on module call
• [FEATURE #124] Add improved logging for db_worker module
• [FEATURE #70] Add logging functionality in email module

1.4.5

What's Changed

• [BUG] Fix missing pdf report in daily email report attachment

1.4.4

What's Changed

• Fixed issue tmp files not removed after scrape task was run #79
• Fixed issue incorrect email body formatting #80

1.4.3

What's Changed

• Fixed reduce redundant log event count in ts.py issue #64
• Fixed missing analytics logging issue #67
• Add daily email functionality sent using sendgrid api issue #65

1.4.2

What's Changed

• [BUG #40] Fix issue when container is crashing if ad age is less than 24 hours
• Add improved logging for task_scheduler module
• Add improved logging for web_scraper module