Improving face recognition with cob_people_detection?

Hello, I am using the most excellent [cob_people_detection](http://wiki.ros.org/cob_people_detection) package under ROS Indigo and Ubuntu 14.04 together with an MS Kinect (Xbox 360) at 640x480 resolution. I have only 5 people so far in the database with 40 images per person taken at different angles but the face recognizer often assigns the wrong label to one of those same people standing in front of the camera. I've tried Fischer faces, EigenFaces, and LDA2D but performance does not change much. Does anyone have any suggestions for improving recognition performance? Thanks!
patrick