[Videos] Auto sync subtitle to video (1 Viewer)

powermarcel10

Retired Team Member
  • Premium Supporter
  • November 30, 2010
    2,839
    898
    32
    Groningen
    Netherlands Netherlands
    Hi guys,

    I like to suggest a new feature for MediaPortal 1.

    I'm using Subcentral to find and download subtitles wich is working pretty good. How ever, it happend a lot of times that a subtitle is not 100% in sync with the video file, so with the subtitle slider in the osd menu I need to get it in sync.

    I thought, there should be a way to get this done automaticly, but I'm not sure..

    So the question is, is there a way to get an option to let MP start the subtitle when the first voice is recognized in the video? That should be awesome!

    No idea if this is possible.. Just an idea!

    Cheers,
    Marcel
     

    mm1352000

    Development Group
  • Team MediaPortal
  • September 1, 2008
    21,571
    8,220
    New Zealand New Zealand
    Country flag
    Hello Marcel

    Interesting idea. I guess it might be possible... but very, very, very challenging. So hard that it would take years of work, and still maybe not work reliably.
    ...but still, interesting. :)

    Identifying voice in an audio track would be the first challenge. For this I guess you'd need a codec that could "parse"/process uncompressed audio to separate the voices from the other sounds. This could be hard. Especially for language-independent speech (different languages sound different => require different recognition techniques?)... and if more than one person is talking at once.

    Second would be recognising that somebody in the video is talking. This would require a code that could "parse"/processed uncompressed video to find the talker. Honestly, this is most likely to be impossible. The person who is talking may not even be shown in the video... or the quality/resolution may be too poor to identify lips moving properly.

    This seems too hard from a technical perspective. Perhaps there's another easier way to do it?
     

    Iwen

    Portal Pro
    August 14, 2007
    464
    32
    Germany Germany
    Country flag
    That would be a great feature.

    Maybe some kind of internal voice recognition. Like a Kinect but as an internal piece of software which just listens to the audio like a person would in front of the TV. I think voice recognition is pretty good nowadays. Then compare the subtitle text with the recognized text and show them accordingly in sync. A little bit like Skype (http://www.skype.com/en/translator-preview/) is trying to do live voice translation, but in this case we already have the written text (subtitle). It needs "just" to be compared to the recognized audio text.

    But still, hard task. But not impossible (I hope :) ).
     

    Users who are viewing this thread

    Similar threads
    OP Title Forum Replies Date
    wizard123 [solved] Auto sizing buttons to text content MediaPortal 1 11
    B TV-Server Auto-Update mptvdb after x hours General Support 0
    HTPCSourcer Forum Titel auto correction Online Facilities 2
    O Steps to achieve AV sync - please tell me I'm missing something General 0
    A Question about Google Drive sync Feature Requests 3
    Glith Audio out of sync after pause. Rewind 15sec gets it into sync again. MediaPortal 1 Talk 0
    ajs Sync databases by Media Sync Service MediaPortal 1 Talk 26
    A Audio sync problems on LAV filters 1.21 Pre Release 31
    fischy667 wrong/no sync with trakt on some series Trakt 2
    W Sync Fehler Allgemeines Support- und Diskussionsforum 1
    mickb Subtitles My TVSeries 9
    M.Hulot Blu-ray: Es werden nicht nur Forced Subtitles angezeigt Allgemeines Supportforum 1
    J How to change y position of subtitles General 3
    R [will not fix] [MP2-832] MP2.2.2 subtitles not shown for WTV files Submit: Bug Reports 7
    S Remote button to change audio and subtitle on / off General 10
    P [solved] ATSC subtitles not fixed yet? General 2
    E Swedish subtitles problem General 2
    ratata Someone stole my subtitles... General Support 0
    Dark Eyes Display subtitles on a separate display or device MediaPortal 1 Plugins 0
    R [solved] Command / Shortcut for changing subtitles or audio Archive 5
    K Multichannel audio and subtitles for TV not properly supported General Support 4
    S Display non english folder name, subtitle, etc. General 23
    S [solved] Movie SRT subtitle didn't display on client 2.2 Archive 18
    S [solved] Live TV subtitle issue if not using 100% font General 31
    D [solved] How to configure subtitle color in MP 2.2.1? General 5

    Similar threads

    Top Bottom