Skip to content

Commit

Permalink
[NLP] Support the different mask tokens used by NLP models for Fill Mask
Browse files Browse the repository at this point in the history
  • Loading branch information
maxhniebergall committed Jul 12, 2023
1 parent 7994247 commit ace6f39
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions specification/ml/_types/inference.ts
Original file line number Diff line number Diff line change
Expand Up @@ -265,6 +265,12 @@ export class NerInferenceOptions {

/** Fill mask inference options */
export class FillMaskInferenceOptions {
/** The string/token which will be removed from incoming documents and replaced with the inference prediction(s).
* In a response, this field contains the mask token for the specified model/tokenizer. Each model and tokenizer
* has a predefined mask token which cannot be changed. Thus, it is recommended not to set this value in requests.
* However, if this field is present in a request, its value must match the predefined value for that model/tokenizer,
* otherwise the request will fail. */
mask_token?: string
/** Specifies the number of top class predictions to return. Defaults to 0. */
num_top_classes?: integer
/** The tokenization options to update when inferring */
Expand Down

0 comments on commit ace6f39

Please sign in to comment.