Speaker Localization

 

The dataset contains videos with three and four speakers in a talk-show panel setting. Two train and two test videos have been recorded with each setup. The speakers perform impromptu conversation. The speaker transitions are fully annotated. In some cases, an overlap between speakers occurs.

For the recording, an HD video camera was used, with a wide shot, as it can be seen in the relevant preview screenshots above. The audio was recorded with two microphones in A-B setup, in order to capture information concerning the spatial characteristics of sound.

The videos serve the purposes of training and validating models for the tasks of Speaker Diarization,Audio/and Visual Speaker Localization, Speaker Indexing, and with the motivation to serve the purposes of creating automations for video broadcasting.

Publications

[in review process]

Download

The dataset can be downloaded here.