Real-Time Student Surveillance System Using Machine Learning and Computer Vision

Main Article Content

Rajat Mehta
Rashi Bhardwaj
Prakash Ramani

Abstract

In a classroom full of students, it is practically not possible for a single teacher to give personal attention to every student. Continuous monitoring and identification of students who show signs of lethargy, sadness or anger in classrooms can help management counsel them and advice some preventive measures – which if kept unchecked can lead the students to take adverse steps. Potential students who need help in some form can be identified. There are some unproductive activities that take place in a classroom which can be easily automated and the time saved can be devoted to productive activities. Manual attendance calling is one of them which can be automated using facial recognition algorithms. In this paper, a robust surveillance system using Machine Learning and Computer Vision algorithms is presented that can take on the above challenges. For facial recognition, Local Binary Pattern Histograms have been used and for emotion recognition, Deep Learning model has been used.

Downloads

Download data is not yet available.

Article Details

Section
Articles
Author Biographies

Rajat Mehta, Manipal University Jaipur

Department of Computer Science and Engineering

Rashi Bhardwaj, Manipal University Jaipur

Department of Computer Science and Engineering

Prakash Ramani, Manipal University Jaipur

Department of Computer Science and Engineering

References

Mental Health, Suicide Data, World Health Organization. https://www.who.int/mental_health/prevention/suicide/suicideprevent/en/, 2016 (Accessed 3 January 2019).

P. Viola and M. Jones, “Rapid object detection using a boosted cascade of simple featuresâ€, In Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA, 2001, pp. I511-I518.

T. Ojala, M. Pietikainen and T. Maenpaa, “Multiresolution gray-scale and rotation invariant texture classification with local binary patternsâ€, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(7), pp. 971-987.

D.E. King, “Dlib-ml: a machine learning toolkitâ€, Journal of Machine Learning Research, 2009, vol. 10, pp. 1755-1758.

I.J. Goodfellow, D. Erhan, P.L. Carrier, A. Courville, M. Mirza, B. Hamner, et al. “Challenges in representation learning: a report on three machine learning contestsâ€, In Lee, M., Hirose, A., Hou, Z.G., Kil, R.M. (Eds.) Neural Information Processing: ICONIP 2013, Part III, Lecture Notes in Computer Science, Berlin, Heidelberg, 2013, 8228, pp. 117–124.

G. Hemalatha and C.P. Sumathi, “A study of techniques for facial detection and expression classificationâ€, International Journal of Computer Science and Engineering Survey, 2014, 5(2), pp. 27-37, https://doi.org/10.5121/ijcses.2014.5203.

P. Viola and M.J. Jones, “Robust real-time face detectionâ€, International Journal of Computer Vision, 2004, 57(2), pp. 137-154.

W.W. Bledsoe, “The model method in facial recognitionâ€, Technical Report PRI 15, Panoramic Research, Inc., Palo Alto, California, 1964.

M. Turk and A. Pentland, “Eigenfaces for recognitionâ€, Journal of Cognitive Neuroscience, 1991, 3(1), pp. 71-86.

D. Huang, C. Shan, M. Ardebilian, Y. Wang and L. Chen, “Local binary patterns and its application to facial image analysis: a surveyâ€, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 2011, 41(6), pp. 765-781.

Y. Sun, D. Liang, X. Wang and X. Tang, “DeepID3: face recognition with very deep neural networksâ€, arXiv:1502.00873 [cs.CV], 2015, https://arxiv.org/abs/1502.00873

J.R. Clarke Sr. and P.M. Clarke, “Sleep detection and driver alert apparatusâ€, United States Patent, Patent No. 5,689,241, https://patents.google.com/patent/US5689241A/en, 1997 (Accessed 25 December 2018).

A.B. Albu, B. Widsten, T. Wang, J. Lan and J. Mah, “A computer vision-based system for real-time detection of sleep onset in fatigued driversâ€, In Intelligent Vehicles Symposium, IEEE, Eindhoven, The Netherlands, 2008, pp. 25-30.

V.B. Hemadri and U.P. Kulkarni, “Detection of drowsiness using fusion of yawning and eyelid movementsâ€, In Unnikrishnan, S., Surve, S., Bhoir, D. (Eds.) Advances in Computing, Communication, and Control: ICAC3 2013, Communications in Computer and Information Science, Berlin, Heidelberg, 2013, 361, pp. 583–594.

P.L. Carrier and A. Courville, “Challenges in representation learning: facial expression recognition challengeâ€, Kaggle Competition, https://www.kaggle.com/c/challenges-in-representation-learning-facial-expression-recognition-challenge/data, 2013 (Accessed 29 September 2018).

D.V. Sang, N.V. Dat and D.P. Thuan, “Facial expression recognition using deep convolutional neural networksâ€, 9th International Conference on Knowledge and Systems Engineering(KSE), IEEE, 2017, pp. 130-135.