Finger Detection
Last updated
Last updated
In this project, we will use MediaPipe to identify the positions of 21 hand landmarks, calculating whether fingers are bent or straight to determine the total number of fingers displayed. The system processes this data in real-time and sends the results via serial communication to a connected Pico microcontroller to control LED lights. This functionality is integrated with an external hardware setup, where LEDs light up to reflect the detected finger count. The project demonstrates the seamless combination of computer vision, embedded systems, and real-time interaction.
The following components will be prepared in the kit for this project:
A Development Board: EIM STEPico
A Breadboard
10 LEDs (5 colors)
Multiple jumper wires
1 USB cable (USB-A to USB-C)
This project comes with a detailed 60-page tutorial packed with step-by-step instructions and helpful illustrations. It walks you through the assembly process and dives into more advanced topics like how microcontrollers work, coding with MicroPython, and understanding key electronic components and sensors. Whether you're just starting out or looking to deepen your knowledge, this guide makes complex ideas easy to follow and fun to learn.
Hardware Setup
Place your STEPico at one end of the breadboard. It would be convenient for following procedures to align the first pair of pins to the first row of power slots.
Insert the LEDs into the breadboard. Make sure each LED’s anode (long leg) is connected to a separate row.
Connect the STEPico GND pin and the ground. Now, the circuit is ready for the next step.
Once your board hardware has been completed, it's time to explore how each component and LEDs interface with each other, and the best tool to appreciate all the controls is through a Microcontroller. . The
In the project, we use Raspberry RP2040 based microcontroller, and in the tutorial we have two sections that provide walk-through codes, guiding you through the foundational steps and acquainting you with microcontroller configurations and micro-Python programming.
Check out this page for details: STEPico & Micropython
To start programming on the Cursor IDE for your Raspberry RP2040 microcontroller project, ensure you have Python version 3.9 or 3.10 installed. You'll need to set up your virtual environment with the following command:
These libraries will automatically bring in dependencies like math, numpy, and time, crucial for handling finger movement data. Below is the basic import structure for your Python scripts:
By following these steps, you'll be well-equipped to manage your project's hardware and software integration effectively.
Artificial Intelligence Learning (AI) + Machine Learning Kit
Instruction and resources
