Kromophone

Exploring the potential link between the perceived colors and sound frequencies doesn’t necessarily mean resorting to advanced spectrum and wavelength analysis. Kromophone was designed to offer users an accessible way to visualize and experience sensory substitution. It will allow them to convert colors from either inputted images or camera feed into corresponding sounds and preview the resulting frequencies, all in a friendly package.

Offering a swift installation process and requiring no additional setup, Kromophone will offer users an attractive interface that sports a clean layout. Three main options will be provided through large, legible buttons that provide good click feedback.

One will be able to choose the camera as the image input device, manually insert images or use a predefined spectrum onto which to perform the color to sound conversion. The utility will then allow people to use their mouse cursor and preview the corresponding sound frequencies when shifting to different colors and their corresponding intensities.

Each of the different three sensory substitution modes will offer people a good degree of customization, allowing them to select a corresponding sweep, its size and average false and size. In order to increase the handling efficiency even more and make the experience more enjoyable, the utility also offers hotkeys.

Users can easily toggle a hints screen, which will provide the different features and their keyboard shortcuts, allowing them to toggle a horizontal sweep, color averaging or access camera exposure lock. However, one minor drawback would be the fact that in the color spectrum mode, the mouse cursor doesn’t have increased precision, starting to convert colors even before reaching the spectrum border.

This application addresses those who wish to experience first hand a form of sensory substitution. It will allow them to either connect a digital camera, manually input images or use the provided color spectrum as color sources. Using their mouse cursor, when performing sweeps over different colors, they will be able to preview the corresponding sound frequencies.