Firebase.
Configures the sliding window context compression mechanism.
Summary
Warning: This API is in Public Preview, which means that the feature is not subject to any SLA or deprecation policy and could change in backwards-incompatible ways.
Constructors and Destructors |
|
|---|---|
SlidingWindow(int? targetTokens)
|
Properties |
|
|---|---|
TargetTokens
|
int
The session reduction target, i.e., how many tokens we should keep.
|
Properties
TargetTokens
int Firebase::AI::SlidingWindow::TargetTokens
The session reduction target, i.e., how many tokens we should keep.
Public functions
SlidingWindow
Firebase::AI::SlidingWindow::SlidingWindow( int? targetTokens )