Face Detectionplat_iosplat_android

With ML Kit's face detection API, you can detect faces in an image and identify key facial features.

With face detection, you can get the information you need to perform tasks like embellishing selfies and portraits, or generating avatars from a user's photo. Because ML Kit can perform face detection in real time, you can use it in applications like video chat or games that respond to the player's expressions.

iOS Android

Key capabilities

Recognize and locate facial features Get the coordinates of the eyes, ears, cheeks, nose, and mouth of every face detected.
Recognize facial expressions Determine whether a person is smiling or has their eyes closed.
Track faces across video frames Get an identifier for each individual person's face that is detected. This identifier is consistent across invocations, so you can, for example, perform image manipulation on a particular person in a video stream.
Process video frames in real time Face detection is performed on the device, and is fast enough to be used in real-time applications, such as video manipulation.

Example results

For each face detected:

Face 1 of 3
Bounding polygon (884.880004882812, 149.546676635742), (1030.77197265625, 149.546676635742), (1030.77197265625, 329.660278320312), (884.880004882812, 329.660278320312)
Angles of rotation Y: -14.054030418395996, Z: -55.007488250732422
Tracking ID 2
Facial landmarks
Left eye (945.869323730469, 211.867126464844)
Right eye (971.579467773438, 247.257247924805)
Bottom of mouth (907.756591796875, 259.714477539062)

... etc.

Feature probabilities
Smiling 0.88979166746139526
Left eye open 0.98635888937860727
Right eye open 0.99258323386311531