Visual-Textual Video Synopsis Generation - Techniques and Applications
University of Central Florida via YouTube
Overview
Syllabus
Intro
Motivation
Video Summarization: Categories
Application: Movie Trailer
Application: Security
Application: Personalization
Challenges
Tackling subjectivity
Video Summarization as Subset Selection
Determinantal Point Process
DPP for Video Summarization
Limitations
Sequential DPP
Sequential-Hierarchical DPP
Summarize the story
Experimental Setup
List of concepts
Evaluation Scenarios
Shortcomings
Constructing Dataset
Collecting Annotations
Dense Concept Tagging
Comparing summaries
User Summaries
Memory Network Encoding
Qualitative Results - Drink - Food
Summary Compiled the first query-focused video summarization dataset
Length of Summary
Length of the Summary
Sequential GDPP (SeqGDPP)
Train and Test Discrepancy
Large-Margin Objective Function
Updated Evaluation Metric
Generic Summarization Results
Query-Focused Summarization Results
Naïve Approach
Issues
Alternative Approach
Advantages
Framework
Caption Generation Network
Visual-Language Content Matching Network
Purport Network
Experiments
Analysis
Ablation Study
Quantitative Results - Visual Domain
Summary ... Chapter 3
Future Work
Taught by
UCF CRCV