Final Artefacts Demos and Explanations Part 2

I first have to say that formal testing of the system in terms of using it whilst working on music was impossible with my current setup - I dont have two computers. However at the expo I have access to another computer loaded up with music software, so it will be possible to demo the systems together in that capacity.

For these examples, I have run the two systems together as colour organs in order to demo and analyse the efficacy of the systems.

While I am waiting for the videos to upload to Youtube, here is a quick phoo to get the idea and allow me to keep typing!

Before I go on, I want to talk about some of the immediate issues I noticed with te system, that perhaps you too have noticed.

I really hadn't considered the fact that one light source cast on to such a surface would cast shadows onto shorter pillars that were off center. When far enough back, you can hit all the longest pillars easily, however the deeper the other pillars are by relation to the longest, the more extreme the shadows cast become.

There is a way round this, however there is only one - to have multiple projector rigs. this is expensive, space consuming, time consuming and noisey. Realistically, for use as a tool for analyitical insight into audio in the studio, it doesn't have much future. This is certainly not to say that it hasn't been extremely insightful as a method for analysing the light speaker though. It has also been a gret way for exploring the power of FFT analysis for splitting up incoming audio rather than traditional filter based EQ's in the analogue domain, such as the MSGEQ7

At this point the diffuser is unpainted as I relly dont have the time, so there is a very slight tinge of orange to the colour, as seen in the above picture. the colour being shown on the acoustic diffuser then should match the laptop screen, which is extremely similar to what the colour organ above is displaying - a kinda of pinky off white tone. As a note, this means there was a pretty even balance of audio frequencies at that point in time, with a slight tendency towards the lows and highs. Turns out that you can gain meaningful insight into audio from colour ;)

The first of the demo videos of these two in action are taking a while to upload, so for now Im going to get on with seting up my Ableton set ready for testing later on this evening on the flatmates.

I have decided that I'm going to be asking them to listen to a bunch of material chosen by them first, then me, in order to get used to the systems first. During this time, I will be going over a bit of basic colour theory with them to make sure they can understand just what is going on. Once this is done, I am going to go through a set bunch of material such as drum loops and musical stems to demonstrate what certain types of sounds look like, I am then going to ask them to indentify what they are listening to without the speakers, using only the light. If they can determine what they are listening to, roughly at least, without listening, then I would say the system has real legs as a tool for metering audio in a creative manner.

I shall also do an intermediate piece about how a made the colour organ within Resolume. Cheers!

Advanced colour theory and Digital LED's vs Analogue LED's

Having now been with the system for over a week, and demonstrated it to a number of people, I definitely feel that the idea has legs beyond this project.

As with anything, I am now seeing how it could be advanced and improved upon, though currently I dont have the know how or the time before hand in date. Yesterday I stumbled upon a very impressive system that uses Digital LED's rather than their fully analogue counterparts that I am using. Now, undoubtedly this is a more complex system, bit it requires a laptop for operation and is a lot more expensive, so it would really be for a different market - my system still has validity (phew!). Also, in real terms this is not a true colour organ, where my system arguably is.

These guys have used FFT processing to calculate the dominant frequency band at any given time and display a corresponding colour, it is rather cool! Rather than blending RGB colours together to generate the rainbow. A set number of 12 colour blends, from Red through to Purple, have been mapped across each and every octave. Should the FFT device pick up more than one note, it will send each further harmonic above the fundamental to the LED striip, with its corresponding key mapped colour. The joy of digital control!

Looking into the future, I would definitely like to continue with this side of LED programming. The power of this system really is limited only by one's grasp of maths... You could have many hundreds of different maps for the digital LED strip, for everything from phase correlation to RMS vs Peak metering systems, random pattern gens, all sorts of crazy stuff.

I have watched this video a fair few times now, along with the previous video found on his YT page. Without doubt his system is more powerful and visually "tight" than mine - he specifically said that he wanted to develop a system beyond the standard  colour organ.

Despite this, it makes for an excellent comparison to my current system and efficacy of mapping colour across one octave vs the whole audio spectrum. There are inherent limitations when mapping all light colour across one octave.Going back to colour theory here for a second, if we mix RGB light in equal amounts, we get white light. When you are playing a fully mixed piece of music in my system, the blend of RGB is calculated by the arduino every 25ms, and displayed as a solid amount at that time. With the system seen above, this would not be possible in its current config. With a full piece of music, it would be almost inevitable for the resulting light output to be anything other than white. Even playing a seventh chord in any octave would cause this to happen. The system seen above has found a very clever and attractive way around this, but it simply wouldnt be possible with non-digital LED strips, which are a lot cheaper than their digital counterparts.

Being honest, though it could be easily be modified to be a properly effective audio metering system, in its current state, I feel like my system better represents the frenetic nature of analogue audio signals. It also better contextualises songs and their phrasing, along with mastering qualities.

Project Explained Part 1 - Arduino, MSGEQ7 and Audio to Colour Theory and Practice

I have had tons of stuff going on recently with the project, so today is going to be a catch us on the written side of it all.

First off I feel like I should give you an update on some of the difficulties that I had been having with the LED side of the project. Firstly, once again I am no electrician and this is all new to me, I have done a lot of reading trying to get my head around electronics and I think I have a stronger idea, but to say I fully understand it would be an exaggeration.

Also, without the code and guidance from a man named Russell, who has been helping via online chat through Blogger and Youtube, I certainly wouldn't have achieved this. He will be credited as such in my dissertation.

I have also had difficulty in getting parts. Well, more the time scales that they come. I completely underestimated how long it would take for some things to arrive, my longer breadboard took 5 weeks!!

I am now nearly there though, all I need to get my hands on is a female TRS Jack input for the audio in, and a 10K resistor, though I may just be able to use one of the 220k ones I already have for that purpose. I also need to soldier the button I got into place, as it is not very Breadboard friendly.

Also my ignorance in implementing the code into the Arduino was also holding me back. I have since figured out what it was that I was doing wrong, so now the Arduino is loaded with the code it needs. By the end of this coming week I should have a working audio-reactive acoustic diffuser. I think it may be the first one in the world! Wouldn't that be exciting. The next post today after this shall be dedicated to the Diffuser build and where that is at, but for now its all LED.

So first off, here is an overview of what is going on. Compared to my last post about Arduino control of LED's, you can see the Breadboard that I waited five weeks for is in place. Damn I wish China wasn't so far away. And amazong was more obvious where you were buying from :( Aaaaanyway.

 

So rather than using the power brick plugged into the Arduino, I am just using the stripped ends of the 12v power brick that came with the LED strip. Hopefully Russell can confirm wether this will work or not, if not then I know how to connect it up his way too, that's fine.

Next we have the potentiometer circuit. Once the board is fully equip with the button, this circuit will allow the user to cycle through the 8 states contained within the code. One button click cycles through these states, where the potentiometer controls the intensity of each program.

 The next circuit is doing the hard graft. Above the middle of the Breadboard, you can see 3 capcitors - 33pf, 0.1uf and 0.01uf (Left to Right). You may have already noticed that the two on the right are twisted together. I shall get some clarification exactly why that is, but I think it is to with stepping the signal down from the audio input, which will be connected this week.

Sticking with the image above, I shall explain what the little black box straddling the middle of the breadboard is. It is called the MSGEQ7 and it is really the brains of the operation here. It is a seven band audio splitter - it splits incoming audio into 7 separate frequency bands from Low to High frequencies.
Below is a small snippet of the Datasheet for the MSGEQ7. It shows the most important signal flow diagrams though. You can also see the specific band passed frequencies it outputs information for.

 
So here you can see a physical diagram and block electrical diagram of the chip (Top Right). If you imagine twisting that diagram round 90 degrees to the left, you have the orientation of the chip on the breadboard. So as I said before, the audio signal comes in through the top right pin, Pin5 (in that orientation). One left, we have the Ground Pin6, nothing to interesting. Next, Pin7 resets the multiplexer operation, on the board this is connected . Pin8 controls the chips onboard oscillator, which is responsible for selecting the frequency of the multiplexor, or how fast the strobe cycles through the audio frequency bands. When the input of Pin8 is high, the multiplexor is reset. When the signal goes low again it enables the Strobe Pin4, which is on the lower side of the chip. Pin3 is the Output, which is the Multiplexed signal. This is connected to the fourth analogue input on the arduino (A3) which unfortunately I forgot to wire up for the picture, but is now in place. Pin1 and Pin2 are the positive and negative power inputs for the chip, the power for which is controlled by the second 0.1uf capacitor.

Next we have the third stage of the Board, which is controlling the LED's. So trying to keep it basic, as I said before the MSGEQ7 spits out a multiplexed output, which means a stream of repeating data. That stream of data contains the volume information for each of the 7 frequency bands that the MSGEQ7 split the audio into.

What we need to do then is convert that data into RGB data which can be turned into coloured light that represents frequency via the LED strip. This is the part of the process that the Arduino takes care of.

If you have read my earlier work on this project, you will know that light and sound are inherently tied together, and one octave of the musical scale (F# through to F#, 370hz - 740hz) can be exactly converted to the octave of the visible light spectrum (Deep Magenta/Red through to Dark Blue/Purple, 406.8ghz - 813.6ghz). To get the exact colour to tone, you multiply the audio frequency by 2 to the power 40. Now we have some context for what I say next.

There are (very basically) three levels of colour. These are known as the Primary, Secondary and Tertiary Colours. The primary colours are out basic building blocks - with them, we can make Secondary and the Tertiary colours. Our primary colours are RGB, Red, Green and Blue. When we combine these together, we can (just about) make any colour in the rainbow. For example, if I wanted to create the colour Yellow from light, I would mix together equal amounts of Red and Green light. It is vastly more complex than this, but an easy way to think of it is how beat frequencies work, it's a form of frequency modulation.You can demonstrate this to yourself by use of some simple maths, though some of you have no doubt got it by now... If you take average between any to colour frequencies, you will get another colour.








Basically, if send varying R,G&B voltage amounts to the LED strip, then we will get a colour representation of the full audio frequency spectrum. Bass shall be represented by pure red, the Mids by green and the Highs by Blue. This can obviously be changed quite easily in the code, but for now it shall be remaining the same as I want to test this as a metering source. The three black things you see sticking out the breadboad are N-Channel Mosfets. They are special resistors that you can think of as Envelope Followers and are what control the flow of Red Green and Blue signal to each channel of the LED strip. It smoothing basically.

In the picture below I am holding that yellow cable for the benefit of Russell, hopefully he can tell me whether or not I can get away with powering the LED strip this way. You can see from earlier pictures that the Power Brick was plugged into the top rail of the Breadboard. I think this way I can avoid having to get a power brick with a proper connection, as I chopped the last one off for the last arduino project.

 Finally we have a picture of it all together. The code is on the Arduino, so hopefully once I have the TRS and button attached I should be plain sailing! The next post is going to be in a while after I have had a break. Once it is composed, I might just leave till tomo morn to post as I will most likely be very tired!