Dinesh Babu Jayagopi

Assistant Professor

Email: jdinesh@iiitb.ac.in


  • Ph.D. (École Polytechnique Fédérale de Lausanne)

Prof. Dinesh Babu obtained his doctorate from Ecole Polytechnic Federale Lausanne (EPFL), Switzerland, beginning of 2011. His research interests are in Audio-Visual Signal Processing, Machine Learning, and Social Computing. Prior to joining IIITB as an assistant professor, he was a Postdoc at the Social Computing Lab, Idiap Research Institute (EPFL) for 2.5 years. Prior to his PhD, he worked as a Senior Research Engineer at Mercedes-Benz Research and Technology, Bangalore for 3 years. He completed his M.Sc.(engg) from I.I.Sc, Bangalore in 2003, specializing in System Science and Signal Processing; and B.Tech in Electronics from Madras Institute of Technology in 2001.

Research Interests

  • Audio Visual Signal, Processing, Applied Machine Learning, Machine Perception, Applied Signal Processing, Social Computing, Human Robot Interaction, Multimedia Analysis, Behavior Analysis

Selected Publications


  • D. Sanches-Cortes, O. Aran, D. Jayagopi, M. Schmid-Mast, and D. Gatica-Perez. Emergent leaders through looking and speaking: from audio-visual data to multimodal recognition, accepted for publication in Springer Journal on Multimodal User Interfaces, 2012.
  • D. Jayagopi, T. Kim, Alex (Sandy) Pentland, and D. Gatica-Perez. Privacy-sensitive recognition of group conversational context with sociometers, Springer Multimedia Systems, 2012, Volume 18, Number 1, Pages 3-14. 
  • D. Jayagopi, and D. Gatica-Perez. Mining group nonverbal conversational patterns using probabilistic topic models, IEEE Transactions on Multimedia, 2010, 12(8), 790-802.
  • D. Jayagopi, H. Hung, C. Yeo, and D. Gatica-Perez. Modeling dominance in group conversations from nonverbal activity cues, IEEE Transactions on Audio, Speech and Language Processing, 2009,17(3), 501-513.


  • M. Haloi, D. Jayagopi. Characterizing driving behavior using automatic visual analysis, Proceedings of the 6th IBM Collaborative Academia Research Exchange Conference (I-CARE) on I-CARE 2014, Bangalore.
  • B.M. Palavalli, H. Krishna, D. Jayagopi. Analyzing gaming-simulations using video based techniques., in the Conference on Technological Ecosystems for Enhancing Multi-culturality (TEEM) 2014, Salamanca, Spain.
  • S. Sheiki, D. Jayagopi, J.-M. Odobez. Context Aware Addressee Estimation for Human Robot Interaction, in the 6th Workshop on Eye Gaze in Intelligent Human Machine Interaction, ACM International Conference on Multimodal Interaction, Dec 2013.
  • D. Jayagopi, J.-M. Odobez. Given that, Should I Respond? Contextual Addressee Estimation in Multi-Party Human-Robot Interactions, in Proc. ACM/IEEE International Conference on Human-Robot Interaction (HRI), Tokyo, Japan, Mar 2013.
  • D. Jayagopi et al. The Vernissage Corpus: A Conversational Human-Robot-Interaction Dataset, in Proc. ACM/IEEE International Conference on Human-Robot Interaction (HRI), Tokyo, Japan, Mar 2013.
  • D. Jayagopi, D. Sanches-Cortes, K. Otsuka, J. Yamato, and D. Gatica-Perez. Linking speaking and looking behavior patterns with group composition, perception, and performance, in Proc. International Conference on Multimodal Interaction(ICMI), Santa Monica, USA, Oct 2012, Outstanding paper award.
  • D. Gatica-Perez, O. Aran, and D. Jayagopi,Small Group Analysis,in A. Vinciarelli, M. Pantic, J. Burgoon, N. Magnenat-Thalmann, (Eds.) Social Signal Processing, Cambridge University Press, in press
  • S. Rasipuram, D. Jayagopi. Automatic Assessment of Communication Skill in Interface-based Employment Interviews using Audio-visual Cues, accepted in the second International workshop on Affective Social Multimedia Computing, IEEE International Conference on Multimedia and Expo (ICME) 2016.
  • P. Venkatesh, D. Jayagopi. Automatic Bharatnatyam Dance Posture Recognition and Expertise Prediction using Depth Cameras, accepted for presentation at the SAI Intelligent Systems Conference 2016 (IntelliSys 2016).T. Mittal, L. Bangalore, D. Jayagopi. A Logo-Based Approach for Recognising Multiple Products on a Shelf, accepted for presentation at the SAI Intelligent Systems Conference 2016 (IntelliSys 2016).
  • K. Shubham, D. Jayagopi. Gesture and Posture Recognition using a Depth Camera with Applications in Employment Interview Behavior Analysis, IEEE CONECCT 2015, Bangalore.
  • G. GopanK, N. Sinha, D. Jayagopi. Hybrid Features based Classification of Alcoholic and Non-alcoholic EEG, IEEE CONECCT 2015, Bangalore.
  • G. GopanK, N. Sinha, D. Jayagopi. EEG Signal Classification in Non-Linear Frame-work with Filtered Training Data, EUSIPCO 2015, Nice, France.



  • DS/NCS/ESD 863 – Machine Perception – Jun to Jul 2016 [at SAMSUNG]
  • DS/NCS/ESD 863 – Machine Perception – Jan to Apr 2016
  • DS/NCS/ESD 863 – Machine Perception – Aug to Dec 2015
  • CS/NCE 854 – Digital Image Processing – Jan to May 2015 with Prof. Sinha
  • CS/NCE 855 – Designing Gaming Simulations – Aug to Dec 2014 with Prof. Sebastiaan Meyer (KTH Sweden)
  • CS/NCE 854 – Digital Image Processing – Aug to Dec 2014 with Prof. Sinha 


  • ES105 – Signal Processing – Aug to Dec 2015 with Prof. Sinha
  • ES104 – Signals and Systems – Jan to May 2015 with Prof. Sinha
  • ES105 – Signal Processing – Aug to Dec 2014
  • ES101 – Basic Electronics – Jan to May 2014 with Prof. Jyotsna


Research & Consulting

  • SERB(DST) –  Automatic prediction of communication skill in self-presentation interviews, video conference based interviews and group discussions
  • CAIR, DRDO – Human Behavior Analysis using Indoor Camera
  • NI R&D – Robust and fast Multi-object tracking and FPGA
  • SIEMENS – Open Platform for Smart Campus
  • IIITB Start up Grant — Automatic Analysis of communicative behavior in job-hiring scenario