Repository navigation
Overflow compaction produces incomplete summaries in tool-heavy sessions #20246
Description
When a session primarily uses tool-based interactions (e.g. the question tool) rather than direct user messages, overflow compaction produces a summary that only covers the beginning of the conversation.
Steps to reproduce:
- Start a session and send one message
- Interact extensively through tool calls (question tool, etc.) — the model loops many times creating assistant messages, but no new user messages are created
- Hit the provider's context limit (e.g. 200K tokens on GitHub Copilot) so overflow compaction triggers
Expected: The summary covers the full session including all tool interactions.
Actual: The summary only covers the very beginning of the session. All tool interaction context from after the initial user message is lost.
Root cause:
The replay-point search in processCompaction (packages/opencode/src/session/compaction.ts) walks backward looking exclusively for role === "user" messages. In sessions where interactions happen through tool responses (stored as tool parts on assistant messages), user messages are rare. The search skips over all assistant turns and lands on the initial user message, causing messages.slice(0, i) to either produce an empty array (triggering the fallback) or a tiny prefix of the session.
Activity
github-actions commentedon Mar 31, 2026
This issue might be a duplicate of existing issues. Please check:
role === "user"checks in compaction/history logic incorrectly handle synthetic or sparse user messages — the root cause overlaps with what you describe inprocessCompaction's replay-point search.alario-tang commentedon Mar 31, 2026
This feels related to how replay-point selection and compaction fallback interact in tool-heavy sessions.
If the summary is incomplete in tool-heavy history, one likely reason is that the current compaction flow has limited options once the summarize set becomes awkwardly large or noisy:
A more robust path here may be:
That would probably improve both compact quality and continuation quality in tool-heavy sessions.
jphpeete commentedon Mar 31, 2026
Agreed on the pruning and retry ideas — those would help with compaction quality regardless of how the split point is chosen.
The PR (#20247) addresses the immediate split-point issue: in tool-heavy sessions the backward walk only matches
role === "user"messages, so it jumps over all assistant turns and slices at the start of the conversation. The fix checks for finished assistant turns first, which finds a split point close to the overflow and keeps most of the session in the summary.The pruning/retry improvements you describe would be good follow-ups on top of this — especially for sessions where even with a good split point, the summarization input is still large.
github-actions commentedon Jul 4, 2026
To stay organized issues are automatically closed after 60 days of no activity. If the issue is still relevant please open a new one.