I wonder if something like a leapmotion would work well in that situation. Many years ago I tried out leapmotion in VR and it worked fairly well at tracking hands and fingers