Home | Research Areas | Director | Research Students
Facilities | Research Publications | VLSI Courses at ODU
Research Collaborations | Important Links

Face location and tracking system in complex background environment

Face detection is the first step in human face recognition and video surveillance. Fast and automatic detection of faces from video sequences is an important task in security applications. The number, location, size and orientation of human faces may vary from frame to frame. A face detection and tracking algorithm from color images in the presence of varying lighting conditions as well as complex background environment is being developed in the VLSI Systems Laboratory. The goal of this research work is to locate human faces in images in natural environments with unconstrained lighting, varying face poses, and varying face geometries and skin colors. The new method detects skin regions over the entire image, and then searches for face candidates based on their spatial arrangements. Eye, mouth, and face boundary maps constructed during the search process verify each face candidate. A set of normalized parameters representing statistical and geometrical features extracted from the segmented regions classifies them as face or non-face regions based on a new classification strategy. It is envisaged that the new method leads to successful detection of faces over a wide range of facial variations in color, position, scale, rotation, pose, and expression.  

References

[1]    M. H.  Yang, D. J.  Kriegman, N.  Ahuja, “Detecting faces in images: A survey,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 1, pp. 34-58, Jan. 2002.

[2]    E. Hjelmas and B.K. Low, “Face detection: A survey,” Journal of Computer Vision and Image Understanding, vol. 83, pp. 236-274, 2001.

[3]    R. Chellappa, C. L. Wilson, and S. Sirohey, “Human and machine recognition of faces: A survey,” Proc. IEEE, vol. 83, pp. 705-740, May 1995.

[4]    R. L. Hsu, M. A. Mottaleb, and A. K. Jain, “Face detection in color images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 696-706, May 2002.

[5]    R.-L. Hsu, M. Abdel-Mottaleb, and A. K. Jain, ``Face detection in color images,'' IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 696-706, May 2002.

[6]    C. Garcia and G. Tziritas, “Face detection using quantized skin color regions merging and wavelet packet analysis,” IEEE Trans. on Mulimedia, vol. 1, no. 3, pp. 264-277, Sept. 1999.

[7]    M. M. Jones and J. M. Rehg, “Statistical color models with application to skin detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 274-280, 1999.

[8]    L. L. Yang and M. A. Robertson, “Multiple-face tracking system for general region-of-interest video coding,” IEEE Proc. International Conference on Image Processing, pp. I347-I350, 2000.

[9]    B. D. Zarit, B. J. Super, and F. K. H. Quek, “Comparison of five color models in skin pixel classification,” Proc. Intl. Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, pp. 58-63, Sept. 1999.

[10]    S. Kawato and J. Ohya, “Automatic skin-color distribution extraction for face detection and tracking,” The 5th Intl. Conf. On Signal Processing, vol. II, pp. 1415-1418, Aug. 2000.

[11]    H. Wu, Q. Chen and M. Yachida, “Face detection from color images using a fuzzy pattern matching method,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 6, pp. 557-563, June 1999.

[12]    J. C. Terrillon, M. N. Shirazi, H. Fukamachi, and S. Akamatsu, “Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images,” Proc. IEEE Intl. Conf. on Face and Gesture Recognition, pp. 54-61, 2000.

[13]    J. Brand and J. S. Mason, “A comparative assessment of three approaches to pixel level human skin detection,” Proc. Intl. Conf. Pattern Recognition, pp. 1056-1059, 2000.

[14]    T. Poggio, and K. Sung,  “Finding human faces with a Gaussian mixture distribution-based face model,” Proc. ACCV'95, Springer, Lecture Note in Computer Science, LNCS-1035, pp. 437—446, 1995.

[15]    S. Spors and R. Rabenstein, “A real-time face tracker for color video,” Proc. IEEE Intl. Conf. on Acoustic, Speech and Signal Processing, pp. 1-4, May 2001.

[16]    K. Schwerdt and J. L. Crowly, “Robust face tracking using color,” Proc. Intl. Conf. Face and Gesture Recognition, pp. 90-95, 2000.

[17]    J. Cox, Y. J. Ghosen, and P. Yianilos, “Feature-based face recognition using mixture distance,” Proc. Computer Vision and Pattern Recognition, pp. 209-216, 1996.

[18]    L. Meng, T. Q. Nguyen, and D. A. Castanon, “An image-based framework for face detection,” Proc. IEEE Intl. Conf. Computer Vision and Pattern recognition, pp. 1-6, 2000.

[19]    A . Nikolaidis and I. Pitas, “Facial feature extraction and determination of pose,” Pattern Recognition, vol.33, pp. 1783-1791, 2000.

[20]    H.P. Graf, T. Chen, E. Petajan, and E. Cosatto, “Locating faces and facial parts,” IEEE Proc. International Workshop on Automatic Face and Gesture Recognition, pp. 277-282, June 1995.

[21]    F. Smeraldi, O. Carmona, and J. Bigun, "Saccadic search with Gabor features applied to eye detection and real-time head tracking,'' Image and Vision Computing, vol. 18, no. 4, pp. 323-329, 2000.

[22]    K. C. Yow and R. Cipolla, “Towards an automatic human face localization system,” Proc. 6th British Machine Conference, vol. 2, pp. 701-710, 1995.

[23]    G. Yang and T. S. Huang, “Human face detection in a complex background environment,” Pattern Recognition, vol. 27, no. 1, pp. 53-63, 1994.

[24]    A. Lanitis, C. J. Taylor, and T. F. Cootes, “ An automatic face identification system using flexible appearance models,” Image and Vision Computing, vol. 13, no. 5, pp. 393-401, 1995.

[25]    K. C. Yow and R. Cipolla, “Feature-based human face detection,” Image and Vision Computing, vol. 15, pp. 713-735, 1997.

[26]    C. H. Morimoto and M. Flickner, “Real-time multiple face detection using active illumination,” Proc. The 4th Intl. Conf. on Automatic Face and Gesture Recognition, pp. 1-6, March 2000.

[27]    K. K. Sung and T. Poggio, “Example-based learning for view-based human face detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, pp. 39-51, 1998.

[28]    A.V. Nefian and M.H. Hayes, “Face detection and recognition using Hidden Markov Models,” Proc. Int. Conf. on Image Processing, vol. 1, pp. 141--145, 1998.

[29]    B. Fröba and C. Küblbeck, "Face Detection and Tracking using Edge Orientation Information," Proc. SPIE Visual Communications and Image Processing, pp. 583-594, 2001

[30]    M. Kirby and L. Sirovich, “Application of the Karhunen-Loeve procedure and the characterization of human faces,” IEEE Trans. Pattern Analysis and Machine Intelligence,” vol. 12, pp. 103-108, Jan.1990.

[31]    Y. Dai and Y. Nakano, “Face texture model based on SGLD and its application in face detection in a color scene,” Pattern Recognition, vol. 29, no. 6, pp. 1007-1017, 1996.

[32]    K. J. Kirchberg, O. Jesorsky, and R. W. Frischholz, “Genetic model optimization for Hausdorff distance-based face localization,” Proc. Intl. ECCV 2002 Workshop on Biometric Authentication, Springer, Lecture Notes in Computer Science, LNCS-2359, pp. 103-111, June 2002.

[33]    H. A. Rowley, S. Baluja, and T. Kanade, “Neural network-based face detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, pp. 23-28, 1998.

[34]    R. Feraud, O. J. Bernier, J. E. Viallet, and M. Collobert, “A fast and accurate face detection based on neural network,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 1, pp. 42-53, Jan. 2001.

[35]    M. Delakis and C. Garcia, “Robust face detection based on convolutional neural networks,” Proc. 2nd Hellenic Conf. on Artificial Intelligence, pp. 367-378, April 2002.

VLSI Systems Laboratory
Department of Electrical and Computer Engineering
College of Engineering and Technology
Old Dominion University
Norfolk, VA 23529, USA