Firebase. AI. SlidingWindow
Configures the sliding window context compression mechanism.
Summary
Constructors and Destructors |
|
|---|---|
SlidingWindow(int? targetTokens)
|
Properties |
|
|---|---|
TargetTokens
|
int
The session reduction target, i.e., how many tokens we should keep.
|
Properties
TargetTokens
int Firebase::AI::SlidingWindow::TargetTokens
The session reduction target, i.e., how many tokens we should keep.
Public functions
SlidingWindow
Firebase::AI::SlidingWindow::SlidingWindow( int? targetTokens )