Models

A person holding their hands up towards webcam, with a green hand skeleton overlaid on top of the hands in 3D

TensorFlow Handpose

handsfree.update({handpose: true})

This model includes a fingertip raycaster, center of palm object, and a minimal THREE environment which doubles as a basic debugger for your project.

A person making various face gestures, with a wireframe mesh laid on top of the face

MediaPipe FaceMesh

handsfree.update({facemesh: true})
  • 468 2D face landmarks
  • Track up to 4 faces at once
  • Extra helpers and plugins coming soon

This model doesn’t come with any bonuses or plugins yet but they’ll come soon. The API will remain exactly the same, so feel free to started with this model today!

A person flailing their arms and legs, with a skeleton overlaid above their arms, torso, legs, and face

MediaPipe Pose

handsfree.update({pose: true})
  • Full body mode with 33 2D pose landmarks
  • Upper body mode with 25 2D upper pose landmarks
  • Extra helpers and plugins coming soon

This model doesn’t come with any bonuses or plugins yet but they’ll come soon. The API will remain exactly the same, so feel free to started with this model today!

A split screen view: on the right is a person moving their head and making face gestures, and on the right is a pointer moving and clicking things in tandem

Jeeliz Weboji

handsfree.update({weboji: true})
  • 6DOF head pose estimations
  • 11 face morphs and 16 helper states
  • Comes with “Face Pointer” based plugins

This model uses morphs to help estimate various face states simultaneously and includes assistive tech plugins for browsing pages with face gestures.

Menu