added post about the audio over stft thing

diff --git a/media/stft/demo.jpg b/media/stft/demo.jpg
new file mode 100644 (file)
index 0000000..579fb20
Binary files /dev/null and b/media/stft/demo.jpg differ

diff --git a/media/stft/forest.jpg b/media/stft/forest.jpg
new file mode 100644 (file)
index 0000000..5dd7357
Binary files /dev/null and b/media/stft/forest.jpg differ

diff --git a/pages/stft.md b/pages/stft.md
new file mode 100644 (file)
index 0000000..60dcb32
--- /dev/null
+++ b/pages/stft.md
@@ -0,0 +1,40 @@
+title: Audio over Video
+abstract: Or - How I learned to stop worrying and love the Fast-Fourier-Transform
+keywords: programming,audio,art
+date: 03/10/2024
+
+Hello!
+
+This is an old post moved from the old blog. But there is more to say now.
+
+<iframe src="https://www.youtube.com/embed/acxykQsh8cw?si=vtFPepZPFSAg_bgR"></iframe>
+
+# The idea
+
+One day I was thinking about if you could move audio over video. Surely it was a far more information dense media? Possibly not?[^1]
+
+I did the napkin maths on a stream of QR codes rushing past, then samples expressed in colours. This would be an easy route. When i thought about it properly, though, it seemed less than intuitive. The whole idea (at this point) was to have the audience interact with the sound in real-time, but what would they be able to do with multi-color noise? Only subtractive interaction. Not good enough.
+
+## Spectograms
+
+Spectrograms! This would be perfect! Very intuitive.. They are made through the fourrier transform, which splits a signal into its frequency components.
+
+I eventually finished building an inital version in python after a year and a half of prototypes. This is all mirrored in the git logs[^2]. Bear in mind I'd already been trying for half a year of on-off work before I finally committed to version management haha.
+
+This proved to be very slow, my laptop at the time had 4GB of RAM so that was probaby part of it.
+
+![image](/stft/demo.jpg "A demo in a house I miss")
+
+I showed this to one of my lectrurers working as a sound artist, he told me to do a pilot exibition and put me in contact with the buildings broadcast engineer.
+
+I decided to learn rust and do a full rewrite. This was actually far faster and more intuitve than the Python and it not only came together quicker, but was massively faster. Especcially considering I had to learn the basics of the language first. This version is in a seperate git repo[^3].
+
+The broadcast engineer was impressed, offered me building space and put me in contact with someone else in the building who might be able to help. At the end of this final meeting, with this final contact, and 2 years of writes and re-writes, I was told it was good. "Find some people to work with" he told me "Y'Know, take over a space!" and he was right! But I don't want to be an artist. I've realised. So i'm taking advice from the commissioners: Kill your babies.
+
+Maybe some day i'll do that pilot exibition, might be fun.
+
+![image](/stft/forest.jpg "The calibration forest")
+
+[^1]: This was around 2 years ago as I write this (04/03/2025).
+[^2]: <https://git.ozva.co.uk/?p=audio-over-stft>
+[^3]: <https://git.ozva.co.uk/?p=rust_fft>