AI Simulator that Quantifies interview Performance with Real-Time Analytics

International Journal of Emerging Research in Science, Engineering, and Management

Vol. 2, Issue 4, pp. 64–72, April 2026

https://doi.org/10.58482/ijersem.v2i4.9

This work is licensed under a Creative Commons Attribution 4.0 International License .

AI Simulator that Quantifies interview Performance with Real-Time Analytics

1E Murali, 2M Rekha, 3Kuppam Nithin, 3Sirisha Pathapati, 3Madduru Sucharitha, 3Varalekhari Neeraj Kumar

1Professor, Department of CSE, Siddharth Institute of Engineering & Technology, Puttur, AP, India.
2Assistant Professor, Department of CSE, Siddharth Institute of Engineering & Technology, Puttur, AP, India.
3UG Scholar, Department of CSE, Siddharth Institute of Engineering & Technology, Puttur, AP, India.

Abstract

Traditional interview preparation often fails to ad- dress the critical role of non-verbal communication, leaving candidates unaware of how their confidence and emotional state are perceived. To bridge this gap, this method presents an AI-driven mock interview simulator that provides a holistic evaluation of a candidate’s performance. The system leverages a multi- modal AI pipeline to analyze a confluence of verbal and non- verbal cues. Key modalities include facial expression analysis for emotional sentiment, vocal tonality assessment for confidence markers such as pitch and pace, and linguistic pattern analysis of the transcribed speech to measure clarity and identify filler word usage. The platform delivers a tailored experience by generating personalized interview questions and culminates in a comprehensive performance report. This report presents users with quantitative metrics and actionable insights, pinpointing specific emotional cues and highlighting concrete areas for development. By providing a safe, data-driven environment for practice, this tool empowers candidates to master the crucial soft skills required to succeed, thereby enhancing their confidence and competitiveness in the modern job market.

Keywords: Multi-model AI Pipeline, Mock Interview Simulator, Real-Time Feedback, Facial Emotion Recognition, Vocal Tone Analysis.

📄 Download Full Text PDF

DOI: https://doi.org/10.58482/ijersem.v2i4.9

Open Access • Peer Reviewed Article

References

  1. H. Touvron et al., "LLAMA: Open and Efficient Foundation Language Models," arXiv, 2023. https://doi.org/10.48550/arXiv.2302.13971
  2. S. I. Serengil and A. Ozpinar, "LightFace: A Hybrid Deep Face Recognition Framework," 2020 Innovations in Intelligent Systems and Applications Conference (ASYU), Istanbul, Turkey, pp. 1–5, 2020. https://doi.org/10.1109/ASYU50717.2020.9259802
  3. B. McFee et al., "librosa: Audio and Music Signal Analysis in Python," Proceedings of the Python in Science Conferences, pp. 18–24, 2015. https://doi.org/10.25080/majora-7b98e3ed-003
  4. M. Nalluri, M. Pentela, and N. R. Eluri, "A Scalable Tree Boosting System: XGBoost," ResearchGate, 2020. https://doi.org/10.22259/2349-476X.0712005
  5. C. Lugaresi et al., "MediaPipe: A Framework for Building Perception Pipelines," arXiv, 2019. https://doi.org/10.48550/arXiv.1906.08172
  6. N. Reimers and I. Gurevych, "Sentence-BERT: Sentence Embeddings Using Siamese BERT-Networks," arXiv, 2019. https://doi.org/10.48550/arXiv.1908.10084
  7. J. Kim, J. Kong, and J. Son, "Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech," arXiv, 2021. https://doi.org/10.48550/arXiv.2106.06103
  8. L. Chen et al., "Automated Scoring of Nonnative Speech Using the SpeechRaterSM V.5.0 Engine," ETS Research Report Series, vol. 2018, no. 1, pp. 1–31, 2018. https://doi.org/10.1002/ets2.12198
  9. S. Poria, E. Cambria, R. Bajpai, and A. Hussain, "A Review of Affective Computing: From Unimodal Analysis to Multimodal Fusion," Information Fusion, vol. 37, pp. 98–125, 2017. https://doi.org/10.1016/j.inffus.2017.02.003
  10. Y. Adepu, V. R. Boga, and S. U., "Interviewee Performance Analyzer Using Facial Emotion Recognition and Speech Fluency Recognition," 2020 IEEE International Conference for Innovation in Technology (INOCON), Bengaluru, India, pp. 1–5, 2020. https://doi.org/10.1109/INOCON50539.2020.9298427
  11. G. S. Rao, M. Jaiganesh, M. A. K., M. A. A. A., N. R., and P. K. Parida, "AI Powered Virtual Job Interview Simulator Using Natural Language Processing," 2025 8th International Conference on Trends in Electronics and Informatics (ICOEI), Tirunelveli, India, pp. 1413–1421, 2025. https://doi.org/10.1109/ICOEI65986.2025.11013504
  12. S. R. Jagtap, "AI-Driven Real-Time Interview Simulation App with Voice Recognition and Facial Analysis," Indian Journal of Science and Technology, vol. 18, no. 25, pp. 2058–2066, 2025. https://doi.org/10.17485/ijst/v18i25.760
Download PDF

This article is part of Volume 2, Issue 4 (April 2026)

2026-04-30