Support video_maxlen_ttl for multi-video cases to better control max framelen per video, and divide max_frames_per_video by video duration automatically #7693
Description
Reminder
- I have read the above rules and searched the existing issues.
Description
Multi-video cases need a param to better control video_maxlen_per_video in a refined way so that we can balance the number of frames occupied by each video.
However we currently only have one param video_maxlen which sets a max number of frames globally for every video. And if we input massive multiple videos, it would just truncate some videos behind instead of trying to decrease the sampled frames of previous videos.
Thus we need a new param like video_maxlen_ttl to help set a total max number of sampled frames, and then divide it by durations of videos automatically to balance frames of each video. While video_maxlen remains its function.
To disable video_maxlen_ttl can be as simple as setting video_maxlen_ttl=video_maxlen*max_num_of_videos.