Connections > Large Language Model connection properties > Connect to Large Language Model
  

Connect to Large Language Model

This is the start of the concept.

Before you begin

Enter a short description of the concept here (required).
This is the start of the concept.

Connection details

This is the start of the concept.
The following table describes the connection properties:
Property
Description
Connection Name
Name of the connection.
Each connection name must be unique within the organization. Connection names can contain alphanumeric characters, spaces, and the following special characters: _ . + -,
Maximum length is 255 characters.
Description
Description of the connection. Maximum length is 4000 characters.
Type
Large Language Model
Use Secret Vault
Stores sensitive credentials for this connection in the secrets manager that is configured for your organization.
This property appears only if secrets manager is set up for your organization.
This property is not supported by Data Ingestion and Replication.
When you enable the secret vault in the connection, you can select which credentials that the Secure Agent retrieves from the secrets manager. If you don't enable this option, the credentials are stored in the repository or on a local Secure Agent, depending on how your organization is configured.
For information about how to configure and use a secrets manager, see Secrets manager configuration.
Runtime Environment
The name of the runtime environment where you want to run tasks.
Select a Secure Agent.
Hosted Agent is not applicable.
Model Category
The type of large language model.
Select Chat for conversation-based APIs or Embedding for text embedding APIs.
Model Provider
The provider of the large language model.
Authentication
The authentication type to connect to the selected model provider.
Endpoint
The endpoint URL of the large language model API provided by the model provider.
API Key
The API key of your account used to authenticate access to the large language model APIs.