r.2024.09.17.0

Summary:

• Working towards improved OCP on Cloud Trino processing, added new SQL and managed trino tables for Azure/GCP providers.
• Update some image references for konflux
• Clean up some internal duplicate monitoring metrics

What's Changed

• COST-5132 Fix duplication in managed ocp on aws flow by @myersCody in #5295
• COST-5132 update Managed OCP on AWS tag matching by @myersCody in #5298
• drop bad invoice months from ingress flow by @lcouzens in #5299
• COST-5134 - Add support for OCP/(GCP/Azure) trino updates by @lcouzens in #5287
• COST-5480 Add verification SQL to check parquet to managed conversion by @myersCody in #5290
• COST-4876 Deploy with ubi9-minimal by @chambridge in #5292
• Update renovate config again by @samdoran in #5297
• chore(deps): update konflux references by @red-hat-konflux in #5288
• COST-5513 Specify registry when pushing metrics by @samdoran in #5304
• COST-5204 Fix duplicate metrics by @chambridge in #5293

Full Changelog: r.2024.09.10.0...r.2024.09.17.0

r.2024.09.10.0

Summary:

• updates to switch over the konflux builds
• updates to OCP-on-AWS data processing

What's Changed

• [COST-5132] OCP AWS Parquet Processing by @cgoodfred in #5263
• Validation checks - dont cross month boundary by @lcouzens in #5278
• chore(deps): update konflux references to a523f60 by @red-hat-konflux in #5279
• [COST-5364] Update Renovate config by @samdoran in #5285

Full Changelog: r.2024.08.29.0...r.2024.09.10.0

r.2024.08.29.0

Summary:

TODO: insert summary

What's Changed

• chore(deps): update konflux references by @red-hat-konflux in #5272
• COST-5437 Update alert thresholds on dashboards by @samdoran in #5273
• COST-5413 - Minor validation bug fixes by @lcouzens in #5270
• Remove deprecated sbom-json-check by @samdoran in #5274
• chore(image): update base image by @github-actions in #5271
• Ignore dev/containers for updates by @samdoran in #5275

Full Changelog: r.2024.08.27.0...r.2024.08.29.0

r.2024.08.27.0

Summary:

Correctly account for Savings Plan Negation in AWS costs. OCP on AWS costs that are covered by a Savings Plan are now accurately reflected.

What's Changed

• COST-4904 Update AWS resource matching to include csi_volume_handle by @myersCody in #5255
• COST-4907 Add temp table to track AWS disk capacities by @myersCody in #5262
• COST-5425 Fix regression with false Unleash flag by @myersCody in #5266
• COST-5098 Correctly attribute SavingsPlanCoveredUsage and SavingsPlanNegation line items to OCP on AWS tables by @lcouzens in #5252
• Add source_uuid to reporting_ocp{cloud}tags_summary.sql in order to reduce the select scale set by @lcouzens in #5261
• COST-5364 Add pipelines and configuration for Konflux by @samdoran (#5268)

Full Changelog: r.2024.08.19.0...r.2024.08.27.0

r.2024.08.19.0

Summary:

The release includes improvements to cost summation accuracy, cleanup after the Trino upgrade, dependency updates, and rate limiting adjustments for cost model updates. Additionally, it involves changes to Trino query handling, removal of deprecated Azure report fields, a switch to priority queue for validation, and updates to Trino and Hive images.

What's Changed

• [COST-5371] Ensure we do not use NULL values when summing by @samdoran in #5253
• Remove missed code during the trino upgrade clean up by @myersCody in #5256
• update dependencies by @maskarb in #5254
• Unleash rate limiting to cost model updates by @lcouzens in #5260
• [COST-4852] Inserting attempts loop to Trino queries by @bacciotti in #5210
• [COST-5254] Drop Azure v1 Report fields by @bacciotti in #5220
• switch validation checks to priority queue by @lcouzens in #5259
• openapi.json cost-type to cost_type by @Ginxo in #5251
• [COST-5385] Update Trino and Hive images by @samdoran in #5258

New Contributors

• @Ginxo made their first contribution in #5251

Full Changelog: r.2024.08.08.0...r.2024.08.19.0

r.2024.08.08.0

Summary:

• Various improvements and minor bug fixes
• Drop support for Azure v1 reports
• Add basic data validation

What's Changed

• [COST-5345] EC2 API - exclude tags when exporting to CSV by @djnakabaale in #5241
• [COST-4620] - Add basic provider data validation by @lcouzens in #5218
• [COST-5370] Update docker compose command by @lcouzens in #5246
• [COST-5367] - Fix Azure ingress required columns by @lcouzens in #5244
• [COST-5347] Filter for active providers when expiring Trino partitions by @myersCody in #5242
• [COST-5161] - Drop Azure v1 support by @lcouzens in #5245
• [COST-5279] Update HCS AWS CCSP Estimate by @cgoodfred in #5217
• [COST-5357] Fully distribute Storage unattributed costs to user projects by @myersCody in #5243
• [COST-5367] Add RG vs sub column support by @lcouzens in #5249
• [COST-4820] Remove all_label unleash flag by @myersCody in #5248
• [COST-5255] Update Azure instance id and send display name for subs by @cgoodfred in #5228
• [COST-5148] EC2 insert sql - set SavingsPlanCoveredUsage unblended_cost to zero by @djnakabaale in #5247

Full Changelog: r.2024.08.01.0...r.2024.08.08.0

r.2024.08.01.0

Summary:

This release contains a minor bug fix for network unattributed distribution.

What's Changed

• [COST-5328] Fully distribute network unattributed costs by @samdoran in #5238

Full Changelog: r.2024.07.31.0...r.2024.08.01.0

r.2024.07.31.0

Summary:

A new feature enhancing storage costs for OpenShift running on Azure as well as a few minor backend improvements.

What's New?

Koku/Cost Management is now able to better report and distribute OpenShift storage costs, especially when running OpenShift on Azure. Enhancements for AWS, GCP and on-premise will follow.

Customers utilizing the Azure Disk CSI Driver storage class to dynamically provision persistent volumes, in conjunction with the latest release of the cost-management-metrics-operator, will now see improved correlation of Azure disk costs to OpenShift projects within the Azure filtered by OpenShift view. The latest operator enables us to collect the unique identifier for disks created by the CSI driver during the creation of persistent volumes.

For customers not using the latest operator, the previous method of matching persistent volume names to Azure disk resource identifiers will still be in use. However, this method can result in uncorrelated costs. We highly recommend adopting the new approach for optimal cost visibility.

Additionally, we've made significant improvements in assigning Azure disk costs to OpenShift projects. Through our extended efforts, we now map the capacity of Azure disks to the product name. This allows us to assign a portion of the disk cost based on the requested persistent volume capacity. The cost allocation is calculated using the following equation:

(Persistent volume capacity / Disk Capacity) * Cost of the Disk
The remaining unallocated portion of the disk cost has now been added under a new project called Storage unattributed. This project will now also include the cost of persistent volumes that have no persistent volume claims.

What's Changed

• [COST-5319] Export EC2 compute response data to CSV by @djnakabaale in #5235
• Update ocp-smoke-tests keywords by @esebesto in #5240

Full Changelog: r.2024.07.29.0...r.2024.07.31.0

r.2024.07.29.0

Summary:

• Minor bug fixes and improvements

What's Changed

• COST-5288 Fix currency for network distribution by @myersCody in #5223
• fix log message for failed parquet conversion by @lcouzens in #5234
• COST-5141 vaccum expired trino partitions by @myersCody in #5171
• COST-5317 Support order by account_alias by @djnakabaale in #5233
• COST-5318 Support exclude instance_name and operating_system params by @djnakabaale in #5232
• COST-4741 - Separate AWS node network costs into a Network unattributed namespace by @samdoran in #5104
• COST-5315 Return network_unattributed_distributed costs in the OCP costs API by @samdoran in #5231

Full Changelog: r.2024.07.23.0...r.2024.07.29.0

r.2024.07.23.0

Summary:

• AWS: New API endpoint for EC2 instances, gated by unleash
• Bug-fix: Fix inadvertently skipping polling after finding no new reports on previous day

What's Changed

• COST-5299 clear cache when table is dropped by migration by @maskarb in #5221
• Update nise and AWS DataTransferGenerator resource IDs by @samdoran in #5222
• COST-5289 EC2 compute API - update openapi doc by @djnakabaale in #5224
• COST-4945 Create a new API to return list of EC2-compute instances by @bacciotti in #5117
• COST-5180 Fix inadvertently skipping polling after finding no new reports on previous day by @lcouzens in #5205
• Consolidate local volume mounts by @maskarb in #5215
• COST-5198 Skip customer save on get request by @chambridge in #5225
• COST-5280 rename cpu/memory request/limits parameters by @maskarb in #5226
• add additional info to INSERT operation by @maskarb in #5227
• COST-4993 gate ec2 endpoint with unleash by @maskarb in #5229

Full Changelog: r.2024.07.18.0...r.2024.07.23.0