- HandPose - KeypointsThis sketch demonstrates how to render all of the 21 keypoints detected by the handPose model.
- HandPose - PaintingThis sketch demonstrates how to draw using the index finger tip and thumb tip keypoints.
- Simple paintingThis sketch demonstrates drawing with mouseX, mouseY, pmouseX, pmouseY.
- HandPose Painting - Stroke WeightThis sketch demonstrates how to change the stroke weight with the left hand.
- HandPose Painting - ColorThis sketch demonstrates how to change colors with left hand taps.
- HandPose - Thumbs up or Thumbs DownThis sketch demonstrates how to recognize a gesture based on the relative positions of two keypoints.
- HandPose - ParticlesThis sketch demonstrates how to emit particles from the keypoints of the hand.
In this video, I explore the HandPose model using ml5.js. I'll demonstrate how to track hand keypoints and create an interactive painting sketch using gestures.
ml5.js website with model documentation and other supporting material.
Syllabus for ITP/IMA course.
Jack's coding tutorials, experiments, and more!
Jack B. Du is an artist and researcher whose work explores the poetic possibilities of code in both analog and digital forms.
Google Research blog post covering the technical details of the HandPose model.
Tensorflow Blog post covering the 2021 updates to hand detection model.
- Editing
by Mathieu Blanchette
- Animations
by Jason Heglund