interface OpenAIChatInput {
    frequencyPenalty: number;
    modelName: string;
    n: number;
    presencePenalty: number;
    streaming: boolean;
    temperature: number;
    topP: number;
    azureExtensionOptions?: AzureExtensionsOptions;
    logitBias?: Record<string, number>;
    maxTokens?: number;
    modelKwargs?: Record<string, any>;
    prefixMessages?: ChatRequestMessage[];
    stop?: string[];
    timeout?: number;
    user?: string;
}

Hierarchy (view full)

Implemented by

Properties

frequencyPenalty: number

A value that influences the probability of generated tokens appearing based on their cumulative frequency in generated text. Positive values will make tokens less likely to appear as their frequency increases and decrease the likelihood of the model repeating the same statements verbatim.

modelName: string

Model name to use

n: number

The number of completions choices that should be generated per provided prompt as part of an overall completions response. Because this setting can generate many completions, it may quickly consume your token quota. Use carefully and ensure reasonable settings for max_tokens and stop.

presencePenalty: number

A value that influences the probability of generated tokens appearing based on their existing presence in generated text. Positive values will make tokens less likely to appear when they already exist and increase the model's likelihood to output new topics.

streaming: boolean

Whether to stream the results or not. Enabling disables tokenUsage reporting

temperature: number

The sampling temperature to use that controls the apparent creativity of generated completions. Higher values will make output more random while lower values will make results more focused and deterministic. It is not recommended to modify temperature and top_p for the same completions request as the interaction of these two settings is difficult to predict.

topP: number

An alternative to sampling with temperature called nucleus sampling. This value causes the model to consider the results of tokens with the provided probability mass. As an example, a value of 0.15 will cause only the tokens comprising the top 15% of probability mass to be considered. It is not recommended to modify temperature and top_p for the same completions request as the interaction of these two settings is difficult to predict.

azureExtensionOptions?: AzureExtensionsOptions
logitBias?: Record<string, number>

A map between GPT token IDs and bias scores that influences the probability of specific tokens appearing in a completions response. Token IDs are computed via external tokenizer tools, while bias scores reside in the range of -100 to 100 with minimum and maximum values corresponding to a full ban or exclusive selection of a token, respectively. The exact behavior of a given bias score varies by model.

maxTokens?: number

Maximum number of tokens to generate in the completion. -1 returns as many tokens as possible given the prompt and the model's maximum context size.

modelKwargs?: Record<string, any>

Holds any additional parameters that are valid to pass to openai.createCompletion that are not explicitly specified on this class.

prefixMessages?: ChatRequestMessage[]

ChatGPT messages to pass as a prefix to the prompt

stop?: string[]

A collection of textual sequences that will end completions generation.

timeout?: number

Timeout to use when making requests to OpenAI.

user?: string

An identifier for the caller or end user of the operation. This may be used for tracking or rate-limiting purposes.

Generated using TypeDoc