generated from amazon-archives/__template_Apache-2.0
-
Notifications
You must be signed in to change notification settings - Fork 129
Open
Labels
documentationImprovements or additions to documentationImprovements or additions to documentationenhancementNew feature or requestNew feature or request
Description
Documentation Section
Current State
The
SummarizingConversationManagerimplements intelligent conversation context management by summarizing older messages instead of simply discarding them. This approach preserves important information while staying within context limits.
summary_ratio(float, default: 0.3): Percentage of messages to summarize when reducing context (clamped between 0.1 and 0.8)
Suggested Improvement
The `SummarizingConversationManager` implements intelligent conversation context management by summarizing older messages instead of simply discarding them. This approach preserves important information while staying within context limits.
-- - `summary_ratio` (float, default: 0.3): Percentage of messages to summarize when reducing context (clamped between 0.1 and 0.8)
+- - `summary_ratio` (float, default: 0.3): Percentage of oldest messages to summarize and replace with their summary when reducing context (clamped between 0.1 and 0.8)Rationale
The current documentation doesn't make clear how exactly the summary_ratio parameter is used. Based on the source code, the suggested improvement describes how it's used.
Additional Context
No response
Metadata
Metadata
Assignees
Labels
documentationImprovements or additions to documentationImprovements or additions to documentationenhancementNew feature or requestNew feature or request