Think out of the box with this tech. It might give you that 2-3 seconds that would make a huge difference.
medium.com

Build a Hardware-based Face Recognition System for $150 with the Nvidia Jetson Nano and Python
Using Python 3.6, OpenCV, Dlib and the face_recognition module