Real-Time Student Surveillance System Using Machine Learning and Computer Vision

Rajat Mehta, Rashi Bhardwaj, Prakash Ramani

Abstract


In a classroom full of students, it is practically not possible for a single teacher to give personal attention to every student. Continuous monitoring and identification of students who show signs of lethargy, sadness or anger in classrooms can help management counsel them and advice some preventive measures – which if kept unchecked can lead the students to take adverse steps. Potential students who need help in some form can be identified. There are some unproductive activities that take place in a classroom which can be easily automated and the time saved can be devoted to productive activities. Manual attendance calling is one of them which can be automated using facial recognition algorithms. In this paper, a robust surveillance system using Machine Learning and Computer Vision algorithms is presented that can take on the above challenges. For facial recognition, Local Binary Pattern Histograms have been used and for emotion recognition, Deep Learning model has been used.

Keywords


Computer Vision; Deep Learning; Facial Recognition; Emotion Recognition

Full Text:

PDF

References


Mental Health, Suicide Data, World Health Organization. https://www.who.int/mental_health/prevention/suicide/suicideprevent/en/, 2016 (Accessed 3 January 2019).

P. Viola and M. Jones, “Rapid object detection using a boosted cascade of simple features”, In Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA, 2001, pp. I511-I518.

T. Ojala, M. Pietikainen and T. Maenpaa, “Multiresolution gray-scale and rotation invariant texture classification with local binary patterns”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(7), pp. 971-987.

D.E. King, “Dlib-ml: a machine learning toolkit”, Journal of Machine Learning Research, 2009, vol. 10, pp. 1755-1758.

I.J. Goodfellow, D. Erhan, P.L. Carrier, A. Courville, M. Mirza, B. Hamner, et al. “Challenges in representation learning: a report on three machine learning contests”, In Lee, M., Hirose, A., Hou, Z.G., Kil, R.M. (Eds.) Neural Information Processing: ICONIP 2013, Part III, Lecture Notes in Computer Science, Berlin, Heidelberg, 2013, 8228, pp. 117–124.

G. Hemalatha and C.P. Sumathi, “A study of techniques for facial detection and expression classification”, International Journal of Computer Science and Engineering Survey, 2014, 5(2), pp. 27-37, https://doi.org/10.5121/ijcses.2014.5203.

P. Viola and M.J. Jones, “Robust real-time face detection”, International Journal of Computer Vision, 2004, 57(2), pp. 137-154.

W.W. Bledsoe, “The model method in facial recognition”, Technical Report PRI 15, Panoramic Research, Inc., Palo Alto, California, 1964.

M. Turk and A. Pentland, “Eigenfaces for recognition”, Journal of Cognitive Neuroscience, 1991, 3(1), pp. 71-86.

D. Huang, C. Shan, M. Ardebilian, Y. Wang and L. Chen, “Local binary patterns and its application to facial image analysis: a survey”, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 2011, 41(6), pp. 765-781.

Y. Sun, D. Liang, X. Wang and X. Tang, “DeepID3: face recognition with very deep neural networks”, arXiv:1502.00873 [cs.CV], 2015, https://arxiv.org/abs/1502.00873

J.R. Clarke Sr. and P.M. Clarke, “Sleep detection and driver alert apparatus”, United States Patent, Patent No. 5,689,241, https://patents.google.com/patent/US5689241A/en, 1997 (Accessed 25 December 2018).

A.B. Albu, B. Widsten, T. Wang, J. Lan and J. Mah, “A computer vision-based system for real-time detection of sleep onset in fatigued drivers”, In Intelligent Vehicles Symposium, IEEE, Eindhoven, The Netherlands, 2008, pp. 25-30.

V.B. Hemadri and U.P. Kulkarni, “Detection of drowsiness using fusion of yawning and eyelid movements”, In Unnikrishnan, S., Surve, S., Bhoir, D. (Eds.) Advances in Computing, Communication, and Control: ICAC3 2013, Communications in Computer and Information Science, Berlin, Heidelberg, 2013, 361, pp. 583–594.

P.L. Carrier and A. Courville, “Challenges in representation learning: facial expression recognition challenge”, Kaggle Competition, https://www.kaggle.com/c/challenges-in-representation-learning-facial-expression-recognition-challenge/data, 2013 (Accessed 29 September 2018).

D.V. Sang, N.V. Dat and D.P. Thuan, “Facial expression recognition using deep convolutional neural networks”, 9th International Conference on Knowledge and Systems Engineering(KSE), IEEE, 2017, pp. 130-135.




DOI: https://doi.org/10.26483/ijarcs.v10i4.6445

Refbacks

  • There are currently no refbacks.


Bookmark and Share


Copyright (c) 2019 International Journal of Advanced Research in Computer Science