Components in the Project:

(Software)

1. (DONE) Getting the Python script to receive signals from the Realsense D435i camera
   • (DONE) Receive the distance from the center pixel of what the camera sees https://github.com/engkangkoh/makingtinkering13/blob/master/1a_dist_to_center_pixel.py
   • (DONE) Create a while loop to refresh and keep receiving distance data from the camera https://github.com/engkangkoh/makingtinkering13/blob/master/1b_dist_to_center_pixel_while_loop.py
   • (DONE) Write out the script for object detection using just distance data (Non-AI)
2. (DONE) Getting the Python script to send activation signals through appropriate ports to the Arduino
   • (DONE) Receiving the distance data, and activate appropriate lights on the Arduino  https://github.com/engkangkoh/makingtinkering13/blob/master/2_python_to_arduino.py https://github.com/engkangkoh/makingtinkering13/blob/master/2_blink_py.ino
3. (DONE) Controlling Motor Driver to vary the speed of the wheels by Pulse Wave Modulation (PWM)
   • (DONE) Receiving the distance data, sending it to the Arduino, and relaying activations to the motor driver to activate appropriate motors                                         https://github.com/engkangkoh/makingtinkering13/blob/master/3_using_motor_driver.ino
4. (FAILED) Replace the computer with a Raspberry Pi
   • (FAILED) Git pulling repository from RealSense SDK GitHub, building and installing the SDK on Raspbian on windows using Virtual Machine
   • (FAILED) Doing the same but installing it on a Raspberry Pi 3B-Error message, not enough ram

      

      

      

5. (DONE) Replaced Raspberry Pi with a Nvidia Jetson Nano
   Linux Commands History: https://docs.google.com/document/d/1NIZ07tTR-BCK5LKgNLPeYqUAgdyaTJSuYmMCfa8vzgc/edit?usp=sharing
   • (DONE) Compiled real sense SDK on Linux. Successfully ran the program on the Jetson Nano
   • (DONE) Downloaded and compiled pyrealsense2 library for Linux
   • (DONE) Installed pyserial
   • (DONE) Installed pygame module and resolved a bug
   • (DONE)  Setup up SSH for remote access
6. (DONE) Writing a python script for Junction (Blindspot) sensing   https://github.com/engkangkoh/makingtinkering13/blob/master/Final_V1.py

(Hardware)

1. (DONE) Getting our prototype to work with the code (Movement)

• • (DONE) Sourced for suitable motor driver for the motor on our first prototype
  • (DONE) Designed and 3D printed a camera mount for the first prototype
  • (DONE) Assembled all the parts needed on the prototype for testing
  • (DONE) Tested prototype with code

2. (DONE)Working on the final product (Wheelchair)

• • (DONE) New design for our final product (Wheelchair)
  • (DONE) Source for parts on our final product.

3. (DONE) Dismantled hoverboard to check the connections and how it runs

• • (FAILED) Found out that the gyro sensor is in-built onto the motor driver controller not suitable for our application.
  • (DONE) Decided to change the motor driver controller and use the remaining parts of the hoverboard for the final product
  • (DONE) Re-wiring the new motor controller board to the motorised hoverboard wheels
  • (DONE) Tested the movement on the motorised hoverboard wheels with the new motor controller board

4. (DONE) Built out the final product frame with aluminium profile