[BUG] Delayed Captions

[OutrageousStorm]

Describe the bug
Captions are not synced to VO clips.

To Reproduce
Steps to reproduce the behavior:

1. Create video in current version. The more paragraphs you add, the easier to tell.

Expected behavior
VO clips should be in sync with the captions.

Desktop (please complete the following information):

• OS: Windows
• Browser: Firefox
• Python Version: 3.11.

Additional context
Here's a video showing what happens.

output.mp4

[mcjill]

I hear you, @OutrageousStorm, but I've used ZapCap's API, and it's actually pretty solid no lag here. Maybe check your setup? Most caption tools rely on it for a reason.

[FujiwaraChoki]

This has been an issue since V1. If anybody is willing to open a PR, I'd appreciate that.

[mrflolo]

Integrating OpenAI whisper as a local model that does the transcribing could fix the issue. Take a look at the stable whisper python package. It has direct functionality to split the transcribed segments into smaller segments, that have acurat timestamps.

import stable_whisper
model = stable_whisper.load_model('base')
result = model.transcribe(audio_path, verbose=None).split_by_length(10)
result.to_srt_vtt(srt_path, word_level=False )

this would do the job and also output the transcript as a .srt

[hellofresh01]

Can you guys help me in setup? Cross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at http://localhost:8080/api/generate. (Reason: CORS header ‘Access-Control-Allow-Origin’ missing). Status code: 200.

Cross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at http://localhost:8080/api/generate. (Reason: CORS request did not succeed). Status code: (null) I am getting this issue