Video Summarization Using Reinforcement Learning With Attention
Aug - Dec 2020
Designed a method for video summarization that incorporates a self-attention mechanism to generate importance scores for the frames to generate video summaries.
Used Reinforcement Learning in the form of REINFORCE policy gradient method with a diversity-representativeness reward to train the model.
Employed the rank comparison method "Kendall's tau" as a means to compare generated summaries in addition to the generic F-score metric, enabling more meaningful comparison between various methodologies.
Designed a method for video summarization that incorporates a self-attention mechanism to generate importance scores for the frames to generate video summaries.
Used Reinforcement Learning in the form of REINFORCE policy gradient method with a diversity-representativeness reward to train the model.
Employed the rank comparison method "Kendall's tau" as a means to compare generated summaries in addition to the generic F-score metric, enabling more meaningful comparison between various methodologies.