[One Shot] Specify recipe_args on CLI

[Satrat]

Requested by research, adding a CLI parameter for passing recipe args

Example Usage

test_recipe.yaml

test_stage:
  obcq_modifiers:
    SparseGPTModifier:
      sparsity: eval(use_sparsity)
      block_size: 128
      sequential_update: False
      quantize: False
      targets: [
        "re:model.layers.\\d+$"
      ]

To run:

python src/sparseml/transformers/sparsification/obcq/obcq.py Xenova/llama2.c-stories15M open_platypus --recipe_args use_sparsity=0.7 --recipe test_recipe.yaml

Update: The output recipe.yaml will now reflect the evaluated argument value. Also added this recipe_arg feature to the finetuning script

[natuan]

@Satrat I've tried out this PR, and while the overwriting of recipe args works as expected, the saved recipe still has the variable argument, i.e. without specific values. This I think will break other flows (e.g. evaluation). Could you please check that from your side?

[Satrat]

@Satrat I've tried out this PR, and while the overwriting of recipe args works as expected, the saved recipe still has the variable argument, i.e. without specific values. This I think will break other flows (e.g. evaluation). Could you please check that from your side?

Good catch! Yes we definitely want the output to reflect the evaluated args, I'll look into it further tomorrow

[Satrat]

@Satrat I've tried out this PR, and while the overwriting of recipe args works as expected, the saved recipe still has the variable argument, i.e. without specific values. This I think will break other flows (e.g. evaluation). Could you please check that from your side?

Good catch! Yes we definitely want the output to reflect the evaluated args, I'll look into it further tomorrow

Just an update on this: I had hoped this would be a quick bug fix, but trying to fix this revealed the new modifier refactor doesn't handle evaluated args correctly during export, so its going to be a bit more involved to fix. I opened a ticket to track: https://app.asana.com/0/1203126676641557/1206186419092269/f and will leave this PR open until its resolved

[rahul-tuli]

LGTM!