SmartBin AI

Created by [Aarav Sharma] β€’ Started on July 23, 2024

I am making SmartBin AI, which is a project that can analyse both the type and percentage of food waste occurring at a school campus/canteen/kitchen. This project will use a Raspberry Pi, as well as its Module 2 camera to capture the image, after taking photos, it will run a Region of Interest (ROI) analysis on all images to find out which photos has plates. After receiving such list of images, it will pass all of them through the OpenAI o4 model and find out what kind of food it is, as well as the percentage of waste.

What I worked on, Total Time Spent -> 37hrs 45 mins

  • July 23 2hrs 24 mins(10 days ago) – Took quite long to complete the next part but I got it done!!! I managed to change the UI interface from terminal or command prompt to a Graphical User Interface using the Tkinter Python library.

UI Update

  • July 23 4hrs 33 mins(10 days ago) – I completed the part of the code that takes images from a folder and converts them into base64. Since computers can’t process images, it requires the image in base64 format, which is a text format for the computer to understand the picture.

Base64 Code

  • July 25 6hrs 39mins(8 days ago) – Completed making the model where I am connecting my Python code with the gpt-4o model specifically for image classification. Moreover, I created a detailed prompt.txt (more than 200 lines of code).

GPT-4o Integration

  • July 26 4hrs 49 mins(7 days ago) – Finally completed the script that constantly takes images every 0.25 seconds and saves it if it satisfies the Region of Interest (ROI) function for plate detection. Now I am going to focus on developing the Graphical User Interface (GUI).

ROI Script

  • July 30 10hrs 41 mins(3 days ago) – I completed the combining of the code as well as the UI interface for the COMPLETE app. This means that the user can simply use it as if it was a web app they were launching! I made this using Tkinter and Python, really happy with this.

Complete UI

  • July 31 6hrs 37 mins(2 days ago) – I finally just finished! I configured the Raspberry Pi OS to also show my app in the desktop as well as the side bar.

Raspberry Pi Integration

  • July 31 2 hrs(2 days ago) – I made a CAD Design of the whole model on fusion 360 and then 3d printed it out! Check the later images to see the project actually being setup in the school!!!

Raspberry Pi Integration Raspberry Pi Integration