Skip to content

Updated the complete “Speak with Your Hands” tutorial to use the modern ml5.js HandPose API.Speak with your hands 2.0#1509

Open
colemanliyah wants to merge 3 commits into
processing:mainfrom
colemanliyah:speak-with-your-hands-2.0
Open

Updated the complete “Speak with Your Hands” tutorial to use the modern ml5.js HandPose API.Speak with your hands 2.0#1509
colemanliyah wants to merge 3 commits into
processing:mainfrom
colemanliyah:speak-with-your-hands-2.0

Conversation

@colemanliyah

@colemanliyah colemanliyah commented Jul 11, 2026

Copy link
Copy Markdown

Resolves PR #1483 (#1483)

  • Replaced all older ml5 examples (ml5.handpose(), modelReady(), predict events, annotations) with the new API:

    • await ml5.handPose()
    • detectStart()
    • keypoints
  • Updated every example sketch to work with the current ml5 version:

    • Detecting hand keypoints
    • Printing prediction data
    • Drawing fingertips
    • Adding images to fingertips
    • Moving objects with fingers
    • Controlling multiple objects with multiple fingers
    • Using conditionals with finger positions
    • Creating gesture-based interactions
  • Embedded all example sketches directly into the tutorial using instead of linking out to external sketches.

  • Added updated comments and explanations to match the new code structure.

  • Updated explanations of prediction data to match the new HandPose output format (keypoints, keypoints3D, handedness, confidence).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant