Pomelo

We implemented physical code blocks that have icons that demonstrate the function of the block such as move forward, right, left or backward. Pomelo will be used in a classroom environment where the teacher creates puzzles for students. Students will arrange the block in order to complete the maze. These kinds of assignments will encourage collaboration between students as well as teach them essential skills like problem-solving and critical thinking. This programming method doesn’t bore students since it feels more like playing with a robot rather than coding.

To create these aforementioned code blocks, we placed an ArUco marker on the top left corner of all sides of the blocks. When the student presses the button on top of the robot, the camera, in the form of the robot, will read these markers from top to bottom and perform the moves accordingly.

To make the interaction between Pomelo and the students more natural, we observed elementary school classes and interviewed teachers. The most optimal design seemed to be a dog-shaped robot. Moreover, we added a display board that shows Pomelo’s eyes and emotions to make the interaction less mechanical and more organic.

Our future goals include implementing a voice assistant to further help students during classes. Students have different paces while learning and it is very easy for a student to fall behind. Pomelo will be answering the students’ questions via visuals on the display board and the voice assistant. Another aspect we want to include is Pomelo being personalized to each student; via camera and microphone, Pomelo will keep track of the student and work on improving their weaker sides.

Code installation guide, 3D design, and electronic componenets can be found below.

Step 1 - Install OpenCV

First you need to install the dependencies, so run these commands on the terminal:

sudo apt-get install libhdf5-dev libhdf5-serial-dev libhdf5-100
sudo apt-get install libqtgui4 libqtwebkit4 libqt4-test python3-pyqt5
sudo apt-get install libatlas-base-dev
sudo apt-get install libjasper-dev

Then you can install opencv using pip:

sudo pip3 install opencv-contrib-python==3.4.3.18

Note: opencv versions that are 4.x are not compatible with the raspberrypi, and we need to install the opencv-contrib version of the library for some of the modules. So if you have it installed, uninstall it using

pip uninstall opencv-python

Step 2- Install pololu_drv8835_rpi library

For this library you have to install wiringpi:

sudo pip3 install wiringpi

Then run these commands to install the pololu_drv8835_rpi library:

git clone https://github.com/pololu/drv8835-motor-driver-rpi.git
cd drv8835-motor-driver-rpi
sudo python3 setup.py install

Step 3- Install Flask

Run this command:

sudo pip3 install Flask 

Step 4- Install pomelo

Run these commands:

cd ~  
git clone https://github.com/HisarCS/pomelo  

Step 5- Make the script executable

Run these commands:

cd ~/pomelo  
chmod +x run.sh  

Step 6- Run it!

Now you can execute the script by this command:

~/pomelo/run.sh  

Optional - Run Pomelo always when Raspberry Pi boots

Run this command:

crontab -e  

Select nano editor
Add the following line to end of the crontab file:

@reboot ~/pomelo/run.sh