Yeah it would be cool to make a VST version, a few people have asked for that. In the meantime it is possible to ouptut midi from LudoTune in the browser and connect it to a DAW via a virtual midi device.
Split view is an interesting idea, hadn't considered that. I was thinking of maybe a cinematic playback mode though where the camera rotates and you can switch to different angles.
And yeah potentially some kind of piano roll representation could be cool to have alongside the 3D, so people can see (and maybe select / edit) cubes that way too. Not sure how to make a 3D piano roll though.
Ah I'm sorry you're having that problem. The audio is scheduled accurately with the web audio api (using Tone.js), but on some devices performance could still be an issue. The best experience is definitely with Chrome or Firefox on desktop/laptop (Safari or mobile devices may not work as well). If you think your device should be capable of running it smoothly (or the frame rate is good, but the audio isn't) it could help me out to know which OS and Browser you're using.
Stutters at ~24 seconds, ~32, maybe 1:30ish, 5 seconds after that... then I lost track. Not very often but when it does it's very jarring. Happens if it's running in the foreground or background, even if I'm not moving around or anything, just listening with tab in focus.
I think it should run smooth because I can play minecraft at 1440p at around 100 fps.
For me the Mad World one stutters before a single note is played: the repeater/clock seems to run, then stop, then "catches up", then stutters again, then one cycle smooth, etc. Sometimes notes are also just skipped, or only the last part of the soundbite is played.
I looked at cpu usage and it pegs a single thread to about 90% so maybe that explains it.
I'm biased of course, but I think there are actually music-makers who enjoy novel and non-linear sequencers like this, particularly for idea generation / experimentation. Not saying it would have mainstream appeal, but there are considerations other than interpretability for some people. E.g. Conditional logic and probability cubes let you do things that can't be done on a normal piano roll. At least that's why I added MIDI output - for the people who want to connect it to their DAW or other MIDI device.
I love the visual elements that drag the music out of the audiospectrum. As a visual person this speaks to me so much more than the traditional 2D way of representing music. It's really cool to see songs visually laid out in a 3D space.
What was your original intent with this project? I feel this would work very well for educational aspects, slightly comparable to sonic-pi, especially when it comes to how easy it is to make something nice.
Thanks that's great to hear! Initially I thought it would be a game/toy just because I personally thought it would be fun to build and share music like this.
The bulk of early users seem to enjoy it just for this as well, although I have had some requests to add more utility for music-makers (some want a LudoTune VST and others potentially a desktop or iPad app).
The educational angle has also been brought up a few times and I think that'd be great, so I'll probably be exploring that further too.