RollingMemoryUnit
Description: Memory unit that only retrieves the most recent messages that are under a token limit. Does not summarize removed messages.
Property | Pattern | Type | Deprecated | Definition | Title/Description |
---|---|---|---|---|---|
+ implementation | No | const | No | - | Implementation |
- encoding | No | string | No | - | Encoding |
- token_limit | No | integer | No | - | Token Limit |
1. Property implementation
Title: Implementation
Type | const |
Required | Yes |
Specific value: "RollingMemoryUnit"
2. Property encoding
Title: Encoding
Type | string |
Required | No |
Default | "o200k_base" |
Description: tiktoken encoding to use when counting tokens
3. Property token_limit
Title: Token Limit
Type | integer |
Required | No |
Default | 32000 |
Description: The maximum number of message tokens to sent to llm