How do you create animations to sync with audio?


i know the sound in Krita is unfinished, but i thought i’d try to make synced animations to audio i’ve already made. by scrubbing the animation timeline and sometimes slowing it to 50%, i tried to make an animated cue card for when to make various visuals happen. first try, it’s slow going and Krita can’t render synced audio so i put them back together in kdenlive. just a short test so i don’t spend too much time on something that won’t work. but i’m curious if anyone else has a different method?

1 Like

There’s no apparent reason or logic to the audio problems.
e.g. I have a ten year old Dell PC with simple on-board sound and I can scrub the timeline with no problems and I have no sync on playback problems.

Do you mean that it can’t play syced audio?
The rendering is done by ffmpeg after the intermediate animation frames and sound file location are passed to ffmpeg. That should work.

i also have an old dell laptop, a nine year old precision m4800 i got last december. sorry if i wasn’t too clear, the video and sound scrub just fine, and playback within krita is perfect. it’s only after rendering that the audio is off, i’ve read old posts about it and did what the suggestions say, to combine audio and video in a different video editor, which worked fine and isn’t much of a pain at all to do. i guess i was just wondering if anyone else has their own method to make video on top of already existing audio within krita, or outside of it. i was gonna try making visual markers in opentoonz but thought i’d try krita first cuz it’s all i’ve been using lately. the goal is to make visuals in krita that happen at specific times that audio happens.

and again, sorry if i’m not so clear with what i mean, what i’m trying to do is have a visual of the audio track, like when some programs shows the audio volume visually, and use that to guide the animation. what i’m making won’t be in the finished video, it’s just to guide where to make visual changes, like a musical score but for animation. just now i thought about running my audio track through some audio visualizer app to get a visual guide. that’s why i was asking what other people have tried in krita. i love krita, just trying to find a good workflow.

I did this some years ago by putting markers in a video editor, just like we did at school when animating on paper. :slight_smile:

Maybe doing something like this would be helpful:

And now with Krita 5 you could probably animate the audio strip directly inside Krita with position keyframes on a transform mask.

2 Likes

Other people have reported that the rendered audio is fine but that’s not helpful to them because they can’t design the keyframe placement due to lack of sync within krita.
It’s a confusing situation.

If you want my complete honest opinion, if you really want audio in your animation don’t render it with audio in krita. Export as an image sequence, and use a video editor to add the audio.

Trying to use audio in krita is a frustrating endeavor, exporting it right is even more. Honestly what i recommend when people need to sync audio is to use other programs like pencil2d or opentoonz to time the animation, and use krita to clean the roughs, color and so on. Things that you don’t need the audio for.

2 Likes

thanks for the replies and links. i’ll try some more things out to try to make animation cues, gonna go look for a Linux visualizer now, we’ll see.

Not entirely helpful, maybe, but I use Tahoma2D to storyboard, maybe do that and then import the file into krita?

It’s also free so maybe that might help?

This topic was automatically closed 15 days after the last reply. New replies are no longer allowed.