Research

We are conducting research on computer vision, machine learning, applied deep learning and multimedia related research problems. In particular, we are interested in image understanding (image parsing, image re-targeting, image re-attentionizing), visual fixation analysis with image, video, audio, depth, touch behavior; salient object detection; action/gesture recognition; human biometrics (human attractiveness, human weight prediction); augmented reality and virtual reality; and deep learning. In short, we like doing something cool.

08/2022 - 07/2023 Principal Investigator, NSF Research Experiences for Undergraduates Supplement. National Science Foundation (NSF). Project Page

08/2020 - 07/2022 Principal Investigator, EAGER: Crowd-AI Sensing Based Traffic Analysis for HCMC Planning Simulation. National Science Foundation (NSF). Project Page

08/2020 - 08/2021 Principal Investigator, AI-assisted system for crystal growth. Lam Research

05/2020– 08/2020 Principal Investigator, A retargeting framework for human detection in the distracted environment. UD Research Council Seed Grant

10/2019– 09/2022 Senior Personnel - Advisor, Large-scale Visual Data Annotation Platform for Artificial Intelligence Applications. Vingroup Innovation Foundation (VINIF)

05/2019– 05/2020 Co-Principal Investigator, Developing Number E-Books Using Adaptive Technology. UD STEM Catalyst Grant

05/2019– 08/2019 Principal Investigator, Mixed Reality Application for Non-Destructive Evaluation Training. UDRI and CAS Fellowship

05/2018– 08/2018 Principal Investigator, A deep learning based framework for camouflaged object detection. UD Research Council Seed Grant

05/2017– 05/2018 Principal Investigator, A framework for object segment collage CAPTCHA. UD STEM Catalyst Grant

08/2017– 12/2017 Principal Investigator, Visual Computing and Mixed Reality. UD Experiential Learning Innovation Fund

04/2017– 07/2017 Principal Investigator, Deep Learning with GPUs. NVIDIA GPU Grant

Research Publications (2016 - present)

  1. [J30] Tung Minh Tran; Tu N. Vu; Nguyen D. Vo; Tam V. Nguyen; Khang Nguyen. "Anomaly Analysis in Images and Videos: A Comprehensive Review", ACM Computing Surveys, 2022, - 2020 Impact Factor: 10.282 (ranked 4/137 in Computer Science Theory & Methods) (SCI).
  2. [J29] Khang Nguyen; Thuan Trong Nguyen; Thuan Q. Nguyen; An Nguyen; Nguyen D. Vo; Tam V. Nguyen. "A Benchmark of Parsing Vietnamese Publications", IEEE Access, 2022, - IF = 3.367 (SCIE).
  3. [J28] Xuan-Duong Nguyen, Anh-Khoa Nguyen Vu, Thanh-Danh Nguyen, Nguyen Phan, Bao-Duy Duyen Dinh, Nhat-Duy Nguyen, Tam V. Nguyen, Vinh-Tiep Nguyen, Duy-Dinh Le. "Adaptive Multi-Vehicle Motion Counting", Journal of Signal, Image and Video Processing , 2022, - IF = 2.157 (SCIE).
  4. [J27] Wei-Chih Chern, Tam V. Nguyen, Vijayan K. Asari, Hongjo Kim. "Impact of Loss Functions on Semantic Segmentation in Far-field Monitoring", Journal of Computer-Aided Civil and Infrastructure Engineering, 2022, - IF = 11.775 (SCIE).
  5. [J26] Anh-Khoa Nguyen Vu, Nhat-Duy Nguyen, Khanh-Duy Nguyen, Vinh-Tiep Nguyen, Thanh Duc Ngo, Thanh-Toan Do, Tam V. Nguyen. "Few-Shot Object Detection via Baby Learning", Journal of Image and Vision Computing, 2022, - IF = 2.818 (SCI).
  6. [J25] Trung-Nghia Le, Tam V. Nguyen, Minh-Triet Tran. “Contextual Guided Segmentation Framework for Semi-supervised Video Instance Segmentation”, Journal of Machine Vision and Applications, 2022, - IF = 2.012 (SCIE).
  7. [J24] Tuan Hoang, Thanh-Toan Do, Tam V. Nguyen, Ngai-Man Cheung. “Multi-Modal Mutual Information Maximization: A Novel Approach for Unsupervised Deep Cross-Modal Hashing”, IEEE Transactions on Neural Networks and Learning Systems, 2022, - IF = 10.451 (SCIE).
  8. [J23] Trung-Nghia Le, Yubo Cao, Tan-Cong Nguyen, Minh-Quan Le, Khanh Nguyen, Thanh-Toan Do, Minh-Triet Tran, Tam V. Nguyen. “Camouflaged Instance Segmentation In-The-Wild: Dataset, Method, and Benchmark Suite”, IEEE Transactions on Image Processing, 2022, - IF = 10.856 (SCI).
  9. [J22] Vatsa Patel, Zhongliang Nie, Trung-Nghia Le, Tam V. Nguyen. “Masked Face Analysis via Multi-Task Deep Learning”, Journal of Imaging, 2021, (E-SCI).
  10. [J21] Dhaval Kadia, Md Zahangir Alom, Ranga Burada, Tam V. Nguyen, Vijayan Asari. “R2U3D: Recurrent Residual 3D U-Net for Lung Segmentation”, IEEE Access, 2021, - IF = 3.745 (SCIE).
  11. [J20] Tam V. Nguyen, Somaraju Kamma, Vamsi Adari, Tyler Lesthaeghe, Thomas Boehnlein, Victoria Kramb. “Mixed Reality System for Non-Destructive Evaluation Training”, Journal of Virtual Reality, (VIRE), 2021, - IF = 3.634 (SCIE).
  12. [J19] Jinnan Yan, Trung-Nghia Le, Khanh-Duy Nguyen, Minh-Triet Tran, Thanh-Toan Do, Tam V. Nguyen. “MirrorNet: Bio-Inspired Camouflaged Object Segmentation”, IEEE Access, Vol. 9, pp. 43290 - 43300, 2021, - IF = 3.745 (SCIE).
  13. [J18] Yousef I Mohamad, Samah S Baraheem, Tam V. Nguyen. “Olympic Games Event Recognition via Transfer Learning with Photobombing Guided Data Augmentation”, Journal of Imaging, Vol. 7, 12 pages, 2021 (E-SCI).
  14. [J17] Tuan Hoang, Thanh-Toan Do, Tam V. Nguyen, Ngai-Man Cheung. “Unsupervised Deep Cross-modality Spectral Hashing”, IEEE Transactions on Image Processing (T-IP), Vol. 29, pp. 8391 – 8406, 2020, - IF = 9.34 (SCI).
  15. [J16] Samah Baraheem, Tam V. Nguyen. “Text-to-image via mask anchor points”, Pattern Recognition Letters (PRL), Vol. 133, pp. 25-32, 2020, - IF = 2.81 (SCI).
  16. [J15] Tam V. Nguyen, Zhe Huang, Saiteja Bethini, Venkata Prasanth, Phu. H. Phung. “Secure CAPTCHAs via Object Segment Collage”, IEEE Access, Vol. 8, pp. 84230 - 84238, 2020, - IF = 4.098 (SCIE).
  17. [J14] Khang Nguyen, Nhut T. Huynh, Phat C. Nguyen, Khanh-D. Nguyen, Nguyen D. Vo, Tam V. Nguyen. “Detecting Objects from Space: An Evaluation of Deep Learning Modern Approaches”, Journal of Electronics, Vol. 9, pp. 583:1-18, 2020, - IF = 1.764 (SCIE).
  18. [J13] Ly Vu, Kha Nguyen, Tam V. Nguyen, Tu Nguyen, Fabio Massacci, Phu H. Phung. “HIT4Mal: Hybrid image transformation for malware classification”, Transactions on Emerging Telecommunications 2/7 Technologies (ETT), 2020, - IF = 1.258 (SCIE).
  19. [J12] Tam V. Nguyen, Khanh Nguyen, Thanh-Toan Do. “Semantic Prior Analysis for Salient Object Detection”, IEEE Transactions on Image Processing (T-IP), Vol. 28, Issue 6, pp. 3130-3141, 2019, - IF = 6.79 (SCI).
  20. [J11] Trung-Nghia Le, Tam V. Nguyen, Zhongliang Nie, Minh-Triet Tran, A. Sugimoto.“Anabranch Network for Camouflaged Object Segmentation.”, Journal of Computer Vision and Image Understanding (CVIU), Vol. 184, pp. 45-56, 2019, IF = 2.645 (SCI).
  21. [J10] Thanh-Toan Do, Tuan Hoang, Dang-Khoa Le, Huu Le, Tam V. Nguyen, Ngai-Man Cheung.“Simultaneous Feature Aggregating and Hashing for Compact Binary Code Learning.”, IEEE Transactions on Image Processing (T-IP), Vol. 28, Issue 10, pp. 4954-4969, 2019, - IF = 6.79 (SCI).
  22. [J9] Khanh-Duy Nguyen, Khang Nguyen, Duy-Dinh Le, Duc Anh Duong, Tam V. Nguyen. “YADA: You Always Dream Again for Better Object Detection”, Journal of Multimedia Tools and Applications (MTA), Vo. 78, No. 19, pp. 28189-28208, 2019, - IF = 2.101 (SCIE).
  23. [J8] Vinh-Tiep Nguyen, Duy-Dinh Le, Minh-Triet Tran, Tam V. Nguyen, Thanh D. Ngo, Shinichi Satoh, Duc A. Duong. “Video Instance Search via Spatial Fusion of Visual Words and Object Proposals”, International Journal of Multimedia Information Retrieval (IJMIR), Vol. 8, Issue 3, pp. 181–192, 2019, IF = 2.2 (E-SCI).
  24. [J7] Thanh-Toan Do, Tuan Hoang, Dang-Khoa Le, Huu Le, Tam V. Nguyen, Ngai-Man. Cheung.“From selective deep convolutional features to compact binary representations for image retrieval”, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 15, No. 2, pp. 43:1-43:22, 2019 - IF = 2.019 (SCIE).
  25. [J6] Khanh-Duy Nguyen, Khang Nguyen, Duy-Dinh Le, Duc Anh Duong, Tam V. Nguyen. “You Always Look Again: Learning to Detect the Unseen Objects”, Journal of Visual Communication and Image Representation (JVCI), Vol. 60, pp. 206-216, 2019 - IF = 2.259 (SCIE).
  26. [J5] Tam V. Nguyen, Qi Zhao, Shuicheng Yan. “Attentive Systems: A Survey”, International Journal of Computer Vision (IJCV) Vol.126, No. 1, pp. 86–110, 2018, - IF = 11.541 (SCI).
  27. [J4] S. Ding, B. Mirza, Z. Lin, J. Cao, X. Lai, Tam V. Nguyen, J. Sepulveda. “Kernel based Online Learning for Imbalance Multiclass Classification”, Neurocomputing, Vol.277, pp. 139–148, 2018 - IF = 3.317 (SCI).
  28. [J3] Tam V. Nguyen, B. Mirza. “Dual-layer Kernel Extreme Learning Machine for Action Recognition”, Neurocomputing, Vol.260, pp. 123–130, 2017 - IF = 3.317 (SCI).
  29. [J1] Tam V. Nguyen, Mohan Kankanhalli. “As-Similar-As-Possible Saliency Fusion”, Multimedia Tools and Applications (MTA), Vol. 76 Issue (8), pp. 10501-10519, 2017 - IF = 1.530 (SCIE).
  30. [J1] Tam V. Nguyen, Jose Sepulveda. “Augmented Immersion: Video Cutout and Gesture-guided Embedding for Gaming Applications”, Multimedia Tools and Applications (MTA), Vol. 75, No. 20, pp. 12351-12363, 2016 - IF = 1.346 (SCIE).
  1. [C31] Sai Pavan Kumar Prakya, Manju Venkata Sainath Madamanchi, Vatsa Patel, Samah Baraheem, Tam V. Nguyen. “Photobombing Removal Benchmarking”. International Symposium on Visual Computing (ISVC) 2022.
  2. [C30] Sai Surya Vaddi, Amira Yousif, Samah Baraheem, Ju Shen, Tam V. Nguyen “House Price Prediction via Visual Cues and Estate Attributes”. International Symposium on Visual Computing (ISVC) 2022.
  3. [C29] Tam V. Nguyen, Thanh Ngoc-Dat Tran, Viet-Tham Huynh, Bao Truong, Minh-Quan Le, Mohit Kumavat, Vatsa S Patel, Mai-Khiem Tran, Minh-Triet Tran. “Data-Driven City Traffic Planning Simulation”. International Symposium on Mixed and Augmented Reality (ISMAR) 2022.
  4. [C28] Hoang-Minh Le, Gia-Huy Nguyen, Viet-Tham Huynh, Minh-Kha Le, Minh-Triet Tran, Tam V. Nguyen, Thanh Ngoc-Dat Tran. “Chemisim: A Web-based VR Simulator for Chemistry Experiments”. International Symposium on Mixed and Augmented Reality (ISMAR) 2022.
  5. [C27] Bao Truong, Trung-Nghia Le, Khanh-Duy Le, Minh-Triet Tran, Tam V. Nguyen. “Public Speaking Simulator with Speech and Audience Feedback”. International Symposium on Mixed and Augmented Reality (ISMAR) 2022.
  6. [C26] Wei-Chih Chern, Vijayan Asari, Tam V. Nguyen, and Hongjo Kim (2022). “Weakly supervised pseudo label generation for construction vehicle segmentation”. The 39th International Symposium on Automation and Robotics in Construction (ISARC 2022), pp. 41-46, 2022. (Selected for Plenary Talks)
  7. [C25] Tan-Cong Nguyen, Tien-Phat Nguyen, Gia-Han Diep, Anh-Huy Tran-Dinh, Tam V. Nguyen, Minh-Triet Tran. "CCBANet: Cascading Context and Balancing Attention for Polyp Segmentation", MICCAI (1) 2021: 633-643
  8. [C24] Linh Truong Dieu, Thuan Trong Nguyen, Nguyen D. Vo, Tam V. Nguyen, Khang Nguyen. "Parsing Digitized Vietnamese Paper Documents", CAIP (1) 2021: 382-392
  9. [C23] Yeji Hong, Wei Chih Chern, Tam V. Nguyen and Hongjo Kim (2021). “Generalization of Construction Object Segmentation Models using Self-Supervised Learning and Copy-Paste Data Augmentation”. The 38th International Symposium on Automation and Robotics in Construction (ISARC 2021), pp. 843-848, 2021.
  10. [C22] Trung-Nghia Le, Vuong Nguyen, Cong Le, Tan-Cong Nguyen, Minh-Triet Tran, Tam V. Nguyen. “CamouFinder: Finding Camouflaged Instances in Images”, AAAI Conference on Artificial Intelligence (AAAI), 2021.
  11. [C21] Trung-Nghia Le, Vuong Nguyen, Cong Le, Tan-Cong Nguyen, Minh-Triet Tran, Tam V. Nguyen. “CamouFinder: Finding Camouflaged Instances in Images”, AAAI Conference on Artificial Intelligence (AAAI), 2021.
  12. [C20] Trung-Nghia Le, Tam V. Nguyen, Quoc-Cuong Tran, Lam Nguyen, Trung-Hieu Hoang, Minh-Quan Le, Minh-Triet Tran. “Interactive Video Object Mask Annotation”, AAAI Conference on Artificial Intelligence (AAAI), 2021.
  13. [C19] Tuan Hoang, Thanh-Toan Do, Tam V. Nguyen, Ngai-Man Cheung. “Direct Quantization for Training Highly Accurate Low Bit-width Deep Neural Networks”, International Joint Conference on Artificial Intelligence (IJCAI), pp. 2111–2118, 2020.
  14. [C18] Samah Baraheem, Trung-Nghia Le, Tam V. Nguyen, Ngai-Man Cheung. “Text-to-Image Synthesis via Aesthetic Layout”, ACM Multimedia Conference (ACM MM), pp. 4485–4487, 2020.
  15. [C17] An Quan, Tiep Nguyen, Cong Nguyen, Tam V. Nguyen, Minh-Triet Tran. “Flood Level Prediction via Human Pose Estimation from Social Media Images”, ACM International Conference on Multimedia Retrieval (ICMR), pp. 479–485, 2020.
  16. [C16] Samah Baraheem, Tam V. Nguyen. “Aesthetic-Aware Text to Image Synthesis”, 54th Annual Conference on Information Sciences and Systems (CISS), pp. 1–6, 2020.
  17. [C15] Quynh M. Chung; Tien D. Le; Thin V. Dang; Nguyen D. Vo, Tam V. Nguyen, Khang Nguyen. “Data Augmentation Analysis in Vehicle Detection from Aerial Videos”, International Conference of Research, Innovation and Vision for the Future (RIVF), 2020.
  18. [C14] Xiang Chen, Tam V. Nguyen, Zhiqi Shen, Mohan Kankanhalli. “LiveSense: Contextual Advertising in Live Streaming Videos”, ACM Multimedia Conference (ACM MM), pp. 392–400, 2019.
  19. [C13] Thomas Sherk, Minh-Triet Tran, Tam V. Nguyen. “SharkTank Deal Prediction: Dataset and Computational Model”, International Conference on Knowledge and Systems Engineering (KSE), pp. 248–253, 2019.
  20. [C12] Zhongliang Nie, Akhil Mattey, Zhe Huang, Tam V. Nguyen. “Revisit of Region-Feature Combinations in Facial Analysis”, IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2018, pp. 2343–2348.
  21. [C11] Tam V. Nguyen, Jiashi Feng, Khang Nguyen. “Denser Trajectories of Anchor Points for Action Recognition”, International Conference on Ubiquitous Information Management and Communication (IMCOM), 2018, pp. 1:1-1:8.
  22. [C10] Nguyen D. Vo, Khanh-Duy Nguyen, Tam V. Nguyen, Khang Nguyen. "Ensemble of Deep Object Detectors for Page Object Detection". IMCOM 2018: 11:1-11:6
  23. [C9] Tam V. Nguyen, Bilal Mirza, Dorothy Tan, Jose Sepulveda. "ASMIM: Augmented Reality Authoring System for Mobile Interactive Manuals". IMCOM 2018: 3:1-3:6
  24. [C8] Joshua W. Buck, Saverio Perugini, Tam V. Nguyen. "Natural Language, Mixed-initiative Personal Assistant Agents"". IMCOM 2018: 82:1-82:8
  25. [C7] Tam V. Nguyen, Luoqi Liu. “Salient Object Detection with Semantic Priors”, International Joint Conference on Artificial Intelligence (IJCAI), 2017, pp. 4499-4505.
  26. [C6] Tam V. Nguyen, Guangyu Gao. “Novel Evaluation Metrics for Seam Carving based Image Retargeting”, International Conference on Image Processing (ICIP) 2017, pp. 450–454.
  27. [C5] Tam V. Nguyen, Luoqi Liu. “Smart Mirror: Intelligent Makeup Recommendation and Synthesis”, ACM Multimedia 2017, pp. 1253–1254.
  28. [C4] Zhe Huang, Vamshi Madaram, Saad Albadrani, Tam V. Nguyen. “Shadow Puppetry with Robotic Arms”, ACM Multimedia Conference (ACM MM) 2017, pp. 1251–1252.
  29. [C3] Tam V. Nguyen, Luoqi Liu, Khang Nguyen. “Image Parsing with Global-to-Local Convolutional Neural Networks”, International Conference on Control, Automation, Robotics and Vision (ICARCV) 2016, pp. 1–6.
  30. [C2] Tam V. Nguyen, Dorothy Tan, Jose Sepulveda. “MARIM: Mobile Augmented Reality for Interactive Manuals”, ACM Multimedia 2016.
  31. [C1] Erik Cambria, Tam V. Nguyen, Brian Cheng, Kenneth Kwok, Jose Sepulveda. “GECKA3D: A 3D Game Engine for Commonsense Knowledge Acquisition ”, AAAI Florida Artificial Intelligence Research Society Conference (FLAIRS) 2016, pp. 299–303.

People


Faculty

The lab was founded and directed by Dr. Tam Nguyen, Associate Professor in the Department of Computer Science at the University of Dayton. See his profile at Google Scholar, or LinkedIn.

Tam Nguyen

PhD Students

Samah Baraheem
Vatsa Patel
Amira Yousif
Thomas Sherk
Ian Cannon
Shruti Singh (co-supervisor)
Abhijeet Gupta (co-supervisor)
Tung Tran (co-supervisor)
Cong Nguyen (co-supervisor)

Master's Students

Meghana Ayyalasomayajula
Reema Tharra
Kunal Agrawal
Rupal Dubey
Anjana Gunathilake
Kushalnath Devaruppal
Deepali Madhukar Darade
Vijay Ganaraju
Ian Cannon (UDRI)
Sai Surya Vaddi
Asaad Alghamdi
Sai Pavan Kumar Praky

Undergraduate Students

Bao Truong (Dean's Summer Fellowship Student)
Conner Klawon (Dean's Summer Fellowship Student)
Umang Jain (Dean's Summer Fellowship Student)
Jaswant Prabhakaran (Dean's Summer Fellowship Student)
Jacob Bish (Dean's Summer Fellowship Student)
Aidan Reichenberg (Honors Thesis Student)

Alumni

Yagnik Trivedi (Research Assistant)
Nileshkumar Wangad
Kalyan Sakkhari (Research Assistant)
Jinnan Yan (Master's thesis, previously funded by Graduate Student Summer Fellowship, SEED Grant, student grader)
Samah Saeed Baraheem (Master's thesis, student grader)
Dhaval Kadia (Master's thesis, now UCSF)
Thomas Sherk (now with UDRI, previously worked on STEM Catalyst grant funded project)
Rohit Muralidhar Kolhe (previously worked as an intern at Columbus)
Zhe Huang (Occuli, previously funded by STEM Catalyst Grant)
Akhil Mattey (Apple)
Zhongliang Nie (Shanghai Em-Data)
Trung-Nghia Le (now with NII, was an intern in 2017)
Vamshi Krishna Madaram (Production Control Units, previously funded as an RA)
Manasa Mudigonda (TransUnion)
Akhila Madari (Atomic Robot)
Abdelmunsef Bader
Asma Almalki
Sai krishna Prashanth Pydeti
Venkata Sai Prasanth Ippagunta (Copart)
Kirthi Priya Guttikonda (World Bank)
Deepika Devulapally
Pujitha Pasham (Walmart)
Saiteja Bethini
Weifan Wang (now with ScaleFlux, previously was a student grader)
Yunheng Liu
Arrvind Sethuraman
Ganesh Mudduluru (currently doing an internship at Crown)
Vamsi Charan Adari (currently doing an internship at Crown, previously worked on STEM Catalyst grant funded project)
Somaraju Kamma (currently doing an internship at Crown, previously worked on STEM Catalyst grant funded project)
Manasi Thakkar (previously worked on STEM Catalyst grant funded project)
Allen Mathew Madathil (previously worked on Catalyst grant funded project, student grader)
Nikhil Suresh Wani (previously worked on Catalyst grant funded project)
Yubo Cao
Karthik Balaji Ashok Kumar
Vinay Kumar Mallineni (previous student grader)
Shreyas Raghunath (student grader)
Yashesh Dinesh Bharti
Yousef Idris Yousef Mohamad
Justen Stall (Dean's Summer Fellowship)

Open positions

Our department is recruiting about 5-6 PhD students with full scholarship (tution waiver + monthly stipends). Application deadline will be in March 1st to start in the Fall semester. Contact Dr. Tam Nguyen if you are interested in doing PhD in computer vision, deep learning, and mixed reality at University of Dayton.

The lab is always looking for UD or external students to join our research projects. If you are interested in doing research on the lab's related topics, feel free to contact Dr. Tam Nguyen for further information. We also welcome visitors worldwide to collaborate in our research activities. Funded research assistant positions will be announced when available.

Some photos of the lab's activities

Music and Theater Building, 2016
DAVIS@CVPR 2017
Anderson Center, 2017
Music and Theater Building, 2018
Ginger and Spice Asian Bistro, 2019
Kettering Lab, 2019
Kettering Lab, 2020
Jessie Hathcock Hall, 2021

Contact

Vision and Mixed Reality Lab

Jessie S. Hathcock Hall, Room 140
Department of Computer Science
University of Dayton
300 College Park Ave
Dayton, OH 45469
Email: tamnguyen@udayton[dot]edu
Phone: +1 937-229-3893
Web: https://vantam.github.io

Latest Update: August 2022.