Models

Large Language Model (LLM)

What's the Role of the Language Model in a Gen AI?

The language model serves as the pivotal component in a Generative AI system. It is responsible for generating answers to user queries, essentially acting as the "brain" of the operation.

What LLM Can I Choose From?

We currently offer a selection of language models to best suit your needs:

• OpenAI: gpt-3.5, gpt-3.5-16k, gpt-4
• MS Azure OpenAI: gpt-3.5, gpt-3.5-16k, gpt-4

We are continuously expanding our offerings, so stay tuned for more options.

What Are the available options for the LLM?

Here is the available options for Large Langage Model of your Gen AI:

Provider
Identifies the company responsible for the language model.
Example: OpenAI

Name
Specifies the variant of the model.
Example: gpt-3.5-turbo-16k

Temperature
Controls the creativity level of the Generative AI. A higher value induces more creative but potentially less focused outputs.
Example: 0.2

Max Tokens to Generate
Sets a hard limit on the number of tokens the model will generate in each response. Exercise caution when setting this parameter, as it can truncate longer answers.
Example: 256