Skip to content

Commit

Permalink
Removed OAI pipeline component files and upgraded command component e…
Browse files Browse the repository at this point in the history
…xamples (#2415)

* removed pipeline files and modified command component files

* refactors and some typo fixes

* outputs added in yaml and black format

* changed images for cli readme
  • Loading branch information
anagarajan97 committed Jun 30, 2023
1 parent 1b7a2f5 commit 3bda898
Show file tree
Hide file tree
Showing 16 changed files with 58 additions and 504 deletions.

This file was deleted.

This file was deleted.

3 changes: 1 addition & 2 deletions cli/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -210,8 +210,7 @@ path|status|description
[jobs/parallel/1a_oj_sales_prediction/pipeline.yml](jobs/parallel/1a_oj_sales_prediction/pipeline.yml)|[![jobs/parallel/1a_oj_sales_prediction/pipeline](https://github.com/Azure/azureml-examples/workflows/cli-jobs-parallel-1a_oj_sales_prediction-pipeline/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-jobs-parallel-1a_oj_sales_prediction-pipeline.yml)|The hello world pipeline job with partition by key
[jobs/parallel/2a_iris_batch_prediction/pipeline.yml](jobs/parallel/2a_iris_batch_prediction/pipeline.yml)|[![jobs/parallel/2a_iris_batch_prediction/pipeline](https://github.com/Azure/azureml-examples/workflows/cli-jobs-parallel-2a_iris_batch_prediction-pipeline/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-jobs-parallel-2a_iris_batch_prediction-pipeline.yml)|The hello world pipeline job with inline parallel job
[jobs/parallel/3a_mnist_batch_identification/pipeline.yml](jobs/parallel/3a_mnist_batch_identification/pipeline.yml)|[![jobs/parallel/3a_mnist_batch_identification/pipeline](https://github.com/Azure/azureml-examples/workflows/cli-jobs-parallel-3a_mnist_batch_identification-pipeline/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-jobs-parallel-3a_mnist_batch_identification-pipeline.yml)|The hello world pipeline job with inline parallel job
[jobs/parallel/3a_mnist_batch_identification/pipeline.yml](jobs/parallel/3a_mnist_batch_identification/pipeline.yml)|[![jobs/parallel/3a_mnist_batch_identification/pipeline](https://github.com/Azure/azureml-examples/workflows/cli-jobs-parallel-3a_mnist_batch_identification-pipeline/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-jobs-parallel-3a_mnist_batch_identification-pipeline.yml)|The hello world pipeline job with inline parallel job
[jobs/parallel/3a_mnist_batch_identification/pipeline.yml](jobs/parallel/3a_mnist_batch_identification/pipeline.yml)|[![jobs/parallel/3a_mnist_batch_identification/pipeline](https://github.com/Azure/azureml-examples/workflows/cli-jobs-parallel-3a_mnist_batch_identification-pipeline/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-jobs-parallel-3a_mnist_batch_identification-pipeline.yml)|The hello world pipeline job with inline parallel job
[cli\foundation-models\azure_openai\openai_completions_finetune_pipeline\openai_completions_finetune_spec.yaml](cli\foundation-models\azure_openai\openai_completions_finetune_pipeline\openai_completions_finetune_spec.yaml)|[![cli\foundation-models\azure_openai\openai_completions_finetune_pipeline\openai_completions_finetune_spec.yaml](.github\workflows\cli-foundation-models-azure_openai-openai_completions_finetune/badge.svg?branch=main)](.github\workflows\cli-foundation-models-azure_openai-openai_completions_finetune.yml)|The hello world pipeline job with inline parallel job


**Endpoints** ([endpoints](endpoints))
Expand Down
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
## How to finetune openai models via CLI mode using command components ?
## How to finetune openai models via CLI mode using command component ?

1. Login to az cli using `az login`

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,26 +9,18 @@ inputs:
model_name: ada

jobs:
model_selector:
type: command
component: azureml://registries/azure-openai-preview/components/openai_model_import/versions/0.2.0
inputs:
model: ${{parent.inputs.model_name}}
outputs:
output_model:
type: uri_folder
mode: mount


finetune:
type: command
component: azureml://registries/azure-openai-preview/components/openai_completions_finetune/versions/0.2.1
pipeline_finetune:
type: pipeline
component: azureml://registries/azure-openai-preview/components/openai_completions_finetune/versions/0.2.9
inputs:
train_dataset:
type: uri_folder
path: azureml:oai_sample_training_data:1
mode: ro_mount
base_model: ${{parent.jobs.model_selector.outputs.output_model}}
validation_dataset:
type: uri_folder
path: azureml:oai_sample_training_data:1
mode: ro_mount
registered_model_name: ft_ada_model_from_cli_doc
model: ${{parent.inputs.model_name}}
outputs:
Expand Down
Binary file not shown.
Binary file not shown.
Binary file not shown.

This file was deleted.

This file was deleted.

1 change: 0 additions & 1 deletion sdk/python/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,6 @@ Test Status is for branch - **_main_**
|endpoints|online|[online-endpoints-deploy-mlflow-model](endpoints/online/mlflow/online-endpoints-deploy-mlflow-model.ipynb)|Deploy an mlflow model to an online endpoint. This will be a no-code-deployment. It doesn't require scoring script and environment.|[![online-endpoints-deploy-mlflow-model](https://github.com/Azure/azureml-examples/actions/workflows/sdk-endpoints-online-mlflow-online-endpoints-deploy-mlflow-model.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-endpoints-online-mlflow-online-endpoints-deploy-mlflow-model.yml)|
|endpoints|online|[online-endpoints-triton](endpoints/online/triton/single-model/online-endpoints-triton.ipynb)|Deploy a custom container as an online endpoint. Use web servers other than the default Python Flask server used by Azure ML without losing the benefits of Azure ML's built-in monitoring, scaling, alerting, and authentication.|[![online-endpoints-triton](https://github.com/Azure/azureml-examples/actions/workflows/sdk-endpoints-online-triton-single-model-online-endpoints-triton.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-endpoints-online-triton-single-model-online-endpoints-triton.yml)|
|foundation-models|azure_openai|[openai_completions_finetune](foundation-models/azure_openai/openai_completions_finetune.ipynb)|*no description*|[![openai_completions_finetune](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-azure_openai-openai_completions_finetune.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-azure_openai-openai_completions_finetune.yml)|
|foundation-models|azure_openai|[openai_completions_finetune_pipeline](foundation-models/azure_openai/openai_completions_finetune_pipeline.ipynb)|*no description*|[![openai_completions_finetune_pipeline](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-azure_openai-openai_completions_finetune_pipeline.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-azure_openai-openai_completions_finetune_pipeline.yml)|
|foundation-models|system|[import_model_into_registry](foundation-models/system/import/import_model_into_registry.ipynb)|*no description*|[![import_model_into_registry](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-system-import-import_model_into_registry.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-system-import-import_model_into_registry.yml)|
|foundation-models|system|[asr-batch-endpoint](foundation-models/system/inference/automatic-speech-recognition/asr-batch-endpoint.ipynb)|*no description*|[![asr-batch-endpoint](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-system-inference-automatic-speech-recognition-asr-batch-endpoint.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-system-inference-automatic-speech-recognition-asr-batch-endpoint.yml)|
|foundation-models|system|[summarization-batch-endpoint](foundation-models/system/inference/summarization/summarization-batch-endpoint.ipynb)|*no description*|[![summarization-batch-endpoint](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-system-inference-summarization-summarization-batch-endpoint.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/sdk-foundation-models-system-inference-summarization-summarization-batch-endpoint.yml)|
Expand Down
Loading

0 comments on commit 3bda898

Please sign in to comment.