Safety is a top priority in mining operations and all precautions must be taken in order to avoid accidents. Distractions while driving can be a big risk, especially when conducting a 24/7 operation. The client therefore wanted to detect and be able to take immediate action if drivers were eating, using the phone or just not following best practices while driving, such as not having both hands on the steering wheel.
We designed and implemented a driver safety application for mining vehicles that operate on NVIDIA Jetson Edge devices using Microsoft’s IoT Hub. We detect when a driver is eating, driving without both hands, etc using computer vision techniques and send the corresponding alerts through an onsite private 4G network. Technologies leveraged include Python, Tensorflow, Docker, NVIDIA Jetson, React, Azure, Microsoft IoT Hub, Azure DevOps.