v0.2.9

Released on April 5, 2023.

Key Features

• [Beta] Aqueduct now has support for loading dataframe and image data from
  the local filesystem as parameters. See client.create_param() for details.

Enhancements

• Improves the artifact storage management process. The integrations page now
  shows which system is being used for artifact storage, and if a migration
  between artifact stores fails, the error will be surfaced on the
  integration details page until the user triggers a new artifact migration.
• Adds metadata to read and write operators' sidesheets. Both sidesheets now
  show which system is being used for the IO operation, and the save operator
  now shows to what location and (if relevant) in what format the data is
  being saved.

Bugfixes

• Fixes typos in MongoDB connection dialog.
• Fixes bug where workflow status at the top of the workflow details page would
  not update in sync with other parts of the page.
• Fixes a bug where stopping the Aqueduct server immediately after starting it
  could potentially trigger and then kill a workflow run that would then
  stay in a pending state permanently.

All Changes

v0.2.8...v0.2.9

All commits

• Eng 2698 Implement v2 api framework by @likawind in #1148
• ENG 2707 MongoDB text consistency in Integration Connection Card by @eunice-chan in #1157
• [ENG-2621] Fix bug where status in workflow header is not correctly updated by @vsreekanti in #1156
• Customize log message in UpdateOnFailure() by @Fanjia-Yan in #1078
• Allow users to create table and image parameters from local data by @Fanjia-Yan in #1077
• [K8s] Handle case where multiple tests race to create the aqueduct namespace by @kenxu95 in #1159
• [Backend] Improve lifecycle management of the artifact storage migration by @kenxu95 in #1146
• Only upload terraform directory when the K8s cleanup fails by @kenxu95 in #1145
• Update the jupyiter notebook links in example workflows section by @jpurusho65 in #1160
• ENG 2154 Add parameter information to save operator by @eunice-chan in #1137
• Eng 2724 enable usage tracking for code spaces by @likawind in #1154
• Eng 2331 Fix bug where workflow run can stay in pending states forever by @likawind in #1144
• Fix a bug where UI builds works in dev mode but not production by @likawind in #1162
• Eng 2702 Implement v2 workflow metadata routes by @likawind in #1151
• Added documentation links to Databricks Dialog by @hsubbaraj-spiral in #1161
• Adds new example notebooks by @vsreekanti in #1158
• Check for data in response payload for failed execution by @jpurusho65 in #1152
• Update README.md by @vsreekanti in #1169
• Enhance flow_run.describe() to also print failed execution state by @kenxu95 in #1163
• Add market landscape diagram to README by @vsreekanti in #1174
• Release 0.2.9 by @kenxu95 in #1170