Description: Azure LLM Unit. Requires model to be defined. See https://www.eidolonai.com/docs/howto/swap_llm for more details.
Authentication is handled oot with one of two mechanisms:
- Static token defined with AZURE_OPENAI_API_KEY
- Token provider defined by AZURE_CLIENT_ID, AZURE_CLIENT_SECRET, and AZURE_TENANT_ID
To use an alternative authentication mechanism, provide a custom token provider.
1. Property implementation
Title: Implementation
Specific value: "AzureLLMUnit"
2. Property model
| |
|---|
| Type | Reference[LLMModel] |
| Required | Yes |
| Default | {"implementation": "eidolon_ai_sdk.apu.llm_unit.LLMModel"} |
Description: The model to use for the LLM. Since Azure deployments use custom names, no default is provided. See https://www.eidolonai.com/docs/howto/swap_llm for more details. on defining custom models.
3. Property temperature
Title: Temperature
| |
|---|
| Type | number |
| Required | No |
| Default | 0.3 |
4. Property force_json
Title: Force Json
| |
|---|
| Type | boolean |
| Required | No |
| Default | true |
5. Property max_tokens
Title: Max Tokens
| |
|---|
| Type | integer |
| Required | No |
| Default | null |
6. Property supports_system_messages
Title: Supports System Messages
| |
|---|
| Type | boolean |
| Required | No |
| Default | true |
7. Property can_stream
Title: Can Stream
| |
|---|
| Type | boolean |
| Required | No |
| Default | true |
8. Property azure_endpoint
Title: Azure Endpoint
Description: The azure_endpoint for the Azure LLM API. ie, “https://eidolon-azure.openai.azure.com/“
9. Property azure_ad_token_provider
| Property | Pattern | Type | Deprecated | Definition | Title/Description |
|---|
| - implementation | No | string | No | - | Implementation |
| - | No | object | No | - | - |
9.1. Property implementation
Title: Implementation
10. Property token_provider_scopes
Title: Token Provider Scopes
| |
|---|
| Type | array of string |
| Required | No |
| Default | ["https://cognitiveservices.azure.com/.default"] |
| Array restrictions |
|---|
| Min items | N/A |
| Max items | N/A |
| Items unicity | False |
| Additional items | False |
| Tuple validation | See below |
10.1. token_provider_scopes items
11. Property api_version
Title: Api Version
| |
|---|
| Type | string |
| Required | No |
| Default | "2024-02-01" |
12. Property client_args
Title: Client Args
