Featured Projects

AI-generated Film:
Digital media companies are increasingly focused on investing in more interactive content. Inspired by the natural language processing (NLP) technologies that have allowed virtual assistants to flourish, we investigate how NLP could help in film production and film presentation, and look for novel ways in which digital media companies could benefit. In particular, on the film presentation side, we propose a novel context-aware question-answering system that would be integrated with SVOD content to allow viewers of video to ask context-sensitive questions about the film they are watching simply by pausing. On the film production side, we investigate the NLP performance of using natural text as an input in automatic character extraction (also known as coreference resolution).



Personalized
Interactive Film:

Interactive film is a video storytelling medium lying between films and video games. Neither frequent interruptions nor scripted choices offers natural and pleasent experience for viewers.  We propose a novel anytime interaction film model where users can choose when, and how much to interact. Furthermore, the complete user experience is personalized by implicitly guiding users to suitable interactions and branching storylines. A story guidance module performs implicit emotion recognition on the user, as they engage with conversational agents representing story characters. Powered by natural language generation, these agents can discuss any topic the user wishes.