(EXPERIMENTAL) Configures hybrid inference.
Signature:
export interface HybridParams
Properties
Property | Type | Description |
---|---|---|
inCloudParams | ModelParams | Optional. Specifies advanced params for in-cloud inference. |
mode | InferenceMode | Specifies on-device or in-cloud inference. Defaults to prefer on-device. |
onDeviceParams | OnDeviceParams | Optional. Specifies advanced params for on-device inference. |
HybridParams.inCloudParams
Optional. Specifies advanced params for in-cloud inference.
Signature:
inCloudParams?: ModelParams;
HybridParams.mode
Specifies on-device or in-cloud inference. Defaults to prefer on-device.
Signature:
mode: InferenceMode;
HybridParams.onDeviceParams
Optional. Specifies advanced params for on-device inference.
Signature:
onDeviceParams?: OnDeviceParams;