Real-time pothole detection system on vehicle using improved YOLOv5 in Malaysia

Au Yang Her, Weng Kean Yew, Pang Jia Yew, Melissa Chong Jia Ying

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Commonly in Malaysia, the road surfaces deteriorate over time which results to potholes. With the increasing number of potholes on the road, it has become a road hazard, potentially harming the safety of the Malaysian citizens. Potholes generally will cause drivers to skew away from their original direction which may result in vehicle damages and/or road accidents. Computer vision has improved significantly in the past decade to improve the technologies that require image processing, such as pothole detection. However, it has several limitations in pothole detection as potholes have inconsistent shapes, making it difficult to obtain an accurate prediction. Another limitation is the speed of the detection algorithm is not able to predict the pothole in real time. In this paper, the use of computer vision technology on vehicles is presented as a form of solution to detect the potholes in real time. A deep learning model based on Convolutional Neural Networks, YOLOv5 is found to improve the accuracy of the prediction as compared to past results. The findings on the trained YOLOv5 model have a mAP@0.5 of 80.8 %, 82.2 % and 82.5 % on the YOLOv5m6, YOLOv5s6 and YOLOv5n6 respectively. The trained YOLOv5n6 model was chosen to be the main image processing model for its robust performance to size ratio. The results were able to demonstrate the actual deployment of the trained YOLOv5n6 model on the road in real time with distance estimation.

Original languageEnglish
Title of host publication48th Annual Conference of the IEEE Industrial Electronics Society 2022
PublisherIEEE
ISBN (Electronic)9781665480253
DOIs
Publication statusPublished - 9 Dec 2022
Event48th Annual Conference of the IEEE Industrial Electronics Society 2022 - Brussels, Belgium
Duration: 17 Oct 202220 Oct 2022

Conference

Conference48th Annual Conference of the IEEE Industrial Electronics Society 2022
Abbreviated titleIECON 2022
Country/TerritoryBelgium
CityBrussels
Period17/10/2220/10/22

Keywords

  • computer vision
  • convolutional neural network
  • pothole detection

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Real-time pothole detection system on vehicle using improved YOLOv5 in Malaysia'. Together they form a unique fingerprint.

Cite this