Safety is a top priority in mining operations and all precautions must be taken in order to avoid accidents. Distractions while driving can be a big risk, especially when conducting a 24/7 operation. The client therefore wanted to detect and be able to take immediate action if drivers were eating, using the phone or just not following best practices while driving, such as not having both hands on the steering wheel.
We designed and implemented a driver safety application for mining vehicles that operate on NVIDIA Jetson Edge devices using Microsoft’s IoT Hub. We detect when a driver is eating, driving without both hands, etc using computer vision techniques and send the corresponding alerts through an onsite private 4G network.
Technologies leveraged include Python, Tensorflow, Docker, NVIDIA Jetson, React, Azure, Microsoft IoT Hub, Azure DevOps.
Thanks to this innovative solution, the mining operation can be monitored from a dashboard. It helps increase safety by sending early warnings of unsafe behaviors that can be used to give feedback to drivers. Also, it helps reduce the human resources needed to monitor the fleet of trucks that operates on a daily basis providing long term cost reductions.