LLM Configuration: Additional Properties
The following table explains about other LLM properties that you may required to configure for selected LLM provider.
Properties Table
| Properties | Description |
|---|---|
| baseUrl | Specifies the endpoint address where the application sends requests to the LLM provider. Use this property to control which service endpoint handles the API calls, such as a regional or custom endpoint. |
| Proxy Details Property: | |
| llmProxyHost | Specifies the host name or IP address of the proxy server used to route LLM requests. |
| llmProxyPort | Specifies the port number of the proxy server used for LLM communication. |
| llmProxyUsername | Specifies the username required to authenticate with the proxy server, if proxy authentication is enabled. |
| llmProxyPassword | Specifies the password used to authenticate with the proxy server. Store this value securely. |
| Time-out related settings: | |
| timeout | Specifies the maximum time the application waits for a response from the LLM provider before failing the request. |
| connectTimeout | Specifies the maximum time the application waits to establish a connection with the LLM provider. |
| Transport type for vertex ai: | |
| vertexAITransportType | Specifies the transport mechanism used to communicate with Vertex AI, such as REST or gRPC. Note: Property is available only for LLM provider type Google Vertex AI. |