Keynote 1: Privacy-aware Multimedia Analytics
Mohan Kankanhalli
School of Computing, National University of Singapore
Mohan Kankanhalli is Provost's Chair Professor of Computer Science at the National University of Singapore (NUS). He is also the Dean of NUS School of Computing. Before becoming the Dean in July 2016, he was the NUS Vice Provost (Graduate Education) during 2014-2016 and Associate Provost during 2011-2013. Mohan obtained his BTech from IIT Kharagpur and MS & PhD from the Rensselaer Polytechnic Institute. Mohan’s research interests are in Multimedia Computing, Computer Vision, Information Security & Privacy and Image/Video Processing. He has made many contributions in the area of multimedia & vision – image and video understanding, data fusion, visual saliency as well as in multimedia security – content authentication and privacy, multi-camera surveillance.
He directs N-CRiPT (NUS Centre for Research in Privacy Technologies) which conducts research on privacy on structured as well as unstructured (multimedia, sensors, IoT) data. N-CRiPT looks at privacy at both individual and organizational levels along the entire data life cycle. He is personally involved in privacy research related to images, video and social media as well as privacy risk management. N-CRiPT, which has been funded by Singapore’s National Research Foundation, works with many industry, government and academic partners. Mohan is a Fellow of IEEE.
Abstract: In this talk, we present our research on privacy-aware multimedia analytics. We will present three works covering different aspects of multimedia analytics.
- The first work is about privacy protection against machines. Utilizing machine learning and big data, algorithms often act as a tool for privacy violation, by automatically selecting content with sensitive information, such as photos that contain faces or vehicle license plates. The key idea is to perturb images using adversarial machine learning to protect image attributes privacy, while ensuring the images are not degraded. We conducted an experimental study to explore factors that influence human sensitivity to visual changes, which led to the concept of a human sensitivity map. Using this map, a human-sensitivity-aware image perturbation model is developed that can subtly alter an image such that sensitive attributes like gender are misclassified.
- The second work concerns privacy-preserving analytics on images. Attributes such as emotions, gender and age in images and videos are important for many applications. Existing methods extract this information from faces in the images. However, faces raise serious privacy concerns as they reveal people’s identity. We first did an eye-tracking based human study of age, gender, and emotion prediction of people in images under various identity preserving scenarios - obfuscating eyes, lower face, head or the full face. Motivated by this study, we successfully developed a deep learning model for attributes prediction under privacy-preserving conditions and we present its results.
- The third work concerns training machine learning models where data sets cannot be shared due to privacy regulations (e.g., from medical studies). A simple yet unconventional approach for anonymized data synthesis can enable third parties to benefit from such valuable data. We propose learning implicitly from visually unrealistic, task-relevant stimuli, which are synthesized by exciting the neurons of a trained neural network. Neuronal excitation serves as a pseudo-generative model, and can be extended to inhibit representations that are associated with specific individuals, thus providing privacy. The stimuli data is then used to train new classification models. Experiments on MNIST and sleep apnea data show that these models offer protection against adversarial association and membership inference attacks.
We will end with a general discussion on privacy concerns related to multimedia analytics.
Keynote 2: Artificial Intelligence: Paving a Path to Digital Economy Transformation
Yong Rui
Lenovo Group
Dr. Yong Rui is the Corporate CTO and Senior Vice President of Lenovo Group. He directs Lenovo’s technical strategies and R&D directions. Additionally, Dr. Rui leads the Lenovo Research organization that investigates intelligent devices, artificial intelligence, 5G, cloud and edge computing, and smart vertical solutions. Prior to joining Lenovo, Dr. Rui spent 18 years with Microsoft where he held various leadership roles in R&D strategy, basic research, technology incubation and product development, and most recently served as Deputy Managing Director of Microsoft Research Asia.
A Fellow of ACM, IEEE, IAPR and SPIE, and a Foreign Member of Academia Europaea and Canadian Academy of Engineering, Dr. Rui is recognized as a leading expert in AI and multimedia analysis. He is a recipient of many awards, including the 2018 ACM SIGMM Technical Achievement Award, the 2017 IEEE SMC Society Andrew P. Sage Best Transactions Paper Award, the 2017 ACM TOMM Nicolas Georganas Best Paper Award, the 2016 IEEE Computer Society Edward J. McCluskey Technical Achievement Award, the 2016 IEEE Signal Processing Society Best Paper Award and the 2010 Most Cited Paper of the Decade Award from Journal of Visual Communication and Image Representation. He holds 70 issued patents, has published 4 books, 12 book chapters, and 200 refereed journal and conference papers. With over 30,000+ citations, and an h-Index of 82, his publications are among the most referenced.
Dr. Rui is an Associate Editor of ACM Trans. on Multimedia Computing, Communication and Applications (TOMM) (2007- ), and a founding Editor of International Journal of Multimedia Information Retrieval (2011- ). He was the Editor-in-Chief of IEEE MultiMedia magazine (2014-2017), and an Associate Editor of IEEE Access (2013-2016), IEEE Trans. on Multimedia (2004-2008), IEEE Trans. on Circuits and Systems for Video Technologies (2006-2010), ACM/Springer Multimedia Systems Journal (2004-2006), and International Journal of Multimedia Tools and Applications (2004-2006). He also served on the Advisory Board of IEEE Trans. on Automation Science and Engineering (2006-2016).
Involved in many facets of the field, Dr. Rui is a member of numerous organizing and program committees for conferences including ACM Multimedia, ACM ICMR, IEEE ICME, SPIE ITCom, and ICPR. He is General Co-Chair of ACM Multimedia in 2009 and 2014, ACM ICMR in 2006 and 2012, and ICIMCS in 2010, and Program Co-Chair of ACM Multimedia in 2006, Pacific Rim Multimedia (PCM) in 2006, and IEEE ICME in 2009. He is on the Steering Committees of ACM Multimedia, ACM ICMR, IEEE ICME and PCM. He is an Executive Member of ACM SIGMM (2009-2010, 2013-2016), and the founding Chair of its China Chapter.
Dr. Rui received his BS from Southeast University Summa cum laude, his MS from Tsinghua University, and his PhD from University of Illinois at Urbana-Champaign (UIUC).
Abstract: With the rapid growth of digital economy, the world is entering a new era of digital transformation. Technologies like the Artificial Intelligence are changing the way we live and work profoundly as we know it. In his talk, we will demonstrate how Artificial Intelligence is empowering the entire value chain of industrial digitalization, using Lenovo’s own intelligent transformation practices in smart manufacturing as an example. We will also look into how the three elements of AI (data, algorithm and computing power) will change in future years.
Keynote 3: How to do Research for Fun and Profit
Divesh Srivastava
AT&T
Divesh Srivastava is the Head of Database Research at AT&T. He is a Fellow of the Association for Computing Machinery (ACM), the Vice President of the VLDB Endowment, co-chair of the ACM Publications Board, on the Board of Directors of the Computing Research Association (CRA), and an associate editor of the ACM Transactions on Data Science (TDS). He has served as the managing editor of the Proceedings of the VLDB Endowment (PVLDB), as associate editor of the ACM Transactions on Database Systems (TODS), and as associate Editor-in-Chief of the IEEE Transactions on Knowledge and Data Engineering (TKDE). He has presented keynote talks at several international conferences, and his research interests and publications span a variety of topics in data management. He received his Ph.D. from the University of Wisconsin, Madison, USA, and his Bachelor of Technology from the Indian Institute of Technology, Bombay, India.
Abstract: Research is characterized as the process of posing new questions, undertaking a creative and systematic inquiry to find answers, and communicating this knowledge to the community. In this talk, I present a personal perspective to early career researchers and Ph.D. students at various stages in their careers on what they can do to help ensure that their research efforts are successful, and the process is enjoyable.
Keynote 4: Navigation Models for Interactive 360-Degree Video Streaming Systems
Klara Nahrstedt
University of Illinois at Urbana-Champaign
Klara Nahrstedt is the Grainger Chair in Engineering Professor in the Computer Science Department, and the Director of Coordinated Science Laboratory in the Grainger College of Engineering at the University of Illinois at Urbana-Champaign. Her research interests are directed toward tele-immersive systems, end-to-end Quality of Service (QoS), resource management in large scale distributed systems and networks, and real-time security and privacy in cyber-physical systems. She is the co-author of multimedia books “Multimedia: Computing, Communications and Applications”, published by Prentice Hall, and “Multimedia Systems”, published by Springer Verlag. She is the recipient of the IEEE Communication Society Leonard Abraham Award for Research Achievements, University Scholar, Humboldt Research Award, IEEE Computer Society Technical Achievement Award, ACM SIGMM Technical Achievement Award, TU Darmstadt Piloty Prize, the Grainger College of Engineering Drucker Award. She was the elected chair of the ACM Special Interest Group in Multimedia (SIGMM) from 2007-2013. She was the general co-chair and TPC co-chair of many international conferences including ACM Multimedia, IEEE Percom, IEEE/ACM Internet of Things Design and Implementation (IoTDI), IEEE SmartgridComm and others. Klara Nahrstedt received her Diploma in Mathematics from Humboldt University, Berlin, Germany in 1985. In 1995, she received her PhD from the University of Pennsylvania in the Department of Computer and Information Science. She is ACM Fellow, IEEE Fellow, AAAS Fellow, and Member of the German National Academy of Sciences (Leopoldina Society).
Abstract: With the emergence of new 360-degree cameras and VR/AR display devices, more diverse multimedia content has become available and with it the demand for the capability of tile-based streaming 360-degree videos to enhance users’ multimedia experience. In this talk, we will discuss the challenges of 360-degree tile-based video streaming due to its large bandwidth and low latency demands and solutions to satisfy the demands, including semantic-aware description of 360-degree videos’ viewing patterns, rate adaptation of tiled videos and view prediction techniques to enable interactive viewing via Head-Mounted Displays. Especially, we will discuss the concept of navigation graphs to (a). capture salient objects and events as well as viewing patterns of users, and (b). map them into efficient tile-based streaming and viewing experience. We will show how navigation graphs are serving as models to capture diverse semantic content and viewing behaviors in the temporal and spatial domains. Experimental results show that navigation graphs, provided jointly with Media Presentation Descriptors, can assist in efficient solutions of the bandwidth and latency challenges associated with view prediction and user’s interactive viewing. We will also discuss next challenges that future viewing patterns and streaming paradigms will bring as the integration of 360-degree videos, 2D/3D videos, and volumetric media in augmented reality applications is coming.
* Joint work with Jounsup Park, Michael Zink, Ramesh Sitaraman, Qian Zhou, Bo Chen, Mingyuan Wu, John Murray, Ayush Sarkar, Eric Lee, Yinjie Zhang