Hello there,
I’m actually writing a scenario for an interactive movie and trying to play the video and sound from score. I split each sequence into separate video and audio files, and now I can control the fades thanks to a video shader (“Fade”) and the audio gain parameter, respectively. So for each sequence I have 4 “tracks” : video, audio, nodal and automation. Looks good so far.
The main issue I see now is that the used RAM grows quickly, much beyond the loaded files size. With previous versions of score (v3 betas) I got up to 15 GB usage, now with first stable 3.0.0 it seems to behave better, but I had previously written an ofx OSCQuery-enabled video player that still shows even better performances than the latest release.
Another (not directly related) issue that keeps me hesitating about managing all medias from score is the “Images” process : I also need to load many images (about 1000) and show some of them that are randomly picked, for EEG calibration purpose. It seems that they are not loaded in memory from start, because when I reach the Images process in the scenario it freezes for a long time and the RAM also grows much beyond the loaded files size, and then I am able to show the images smoothly until I restart the scenario. For information the files take a little more than 300 MB, and the memory usage grows above 6 GB, which seems a bit weird.
So for now I think I will add this functionnality to my ofx program, which will also make it easier for me to display procedural visuals on top of the video sequences (I currently have no idea how to do this with shaders or custom score plugins), and use score to manage the timing/logic of the project only.
Just reporting the issues for this particular use case, in case it helps for the development.
Cheers !
PS : just forgot to mention another video related issue : when going into fullscreen, the video is stretched to fit the screen size, so the used projector dimensions MUST match the video dimensions otherwise the result is not what one would expect (black stripes to fill extra space without cropping the video instead of stretching)