Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MLOps 1.5] Autogenerate data logging configs from the registry #867

Merged
merged 94 commits into from
Feb 3, 2023

Conversation

dbogunowicz
Copy link
Contributor

@dbogunowicz dbogunowicz commented Jan 19, 2023

Feature Preview:

string_result = data_logging_config_from_predefined(
        group_names="image_classification",
        frequency=2
        loggers={"some_logger": {"arg_1": 10}},
    )

outputs:

loggers:
  python: null

data_logging:
  pipeline_outputs.labels:
  - func: predicted_classes
    frequency: 1
  - func: predicted_top_score
    frequency: 1
  pipeline_inputs.images:
  - func: image_shape
    frequency: 1
  - func: mean_pixels_per_channel
    frequency: 1
  - func: std_pixels_per_channel
    frequency: 1
  - func: fraction_zeros
    frequency: 1

Description

Introduces a new helper function, data_logging_config_from_predefined, that generates data logging configurations using metric group names and optional arguments. The function enables developers to quickly generate examples of data logging configurations, as demonstrated in the examples/data-logging-configs directory.

This PR includes comprehensive testing and features a test that, when run with the appropriate environment variable, can regenerate a fresh set of examples. This functionality is useful for maintaining up-to-date configurations as the log structure evolves over time. :

GENERATE_CONFIGS=1 pytest tests/deepsparse/loggers/metric_functions/helpers/test_data_config_from_predefined.py 

bogunowicz@arrival.com and others added 30 commits January 9, 2023 13:03
…ne' into feature/damian/refactor_function_logger
Co-authored-by: Benjamin Fineran <bfineran@users.noreply.github.com>
Base automatically changed from feature/damian/refactor_function_logger to main January 26, 2023 14:28
@dbogunowicz dbogunowicz changed the base branch from main to feature/damian/deco January 27, 2023 16:00
Base automatically changed from feature/damian/deco to main January 30, 2023 14:03
Copy link
Contributor

@corey-nm corey-nm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the yamls look good to me!

@dbogunowicz dbogunowicz merged commit 0b5887f into main Feb 3, 2023
@dbogunowicz dbogunowicz deleted the feature/damian/config_generation branch February 3, 2023 14:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants