Project nomad - Initial Proposal - Music Tech Design Challenge

Hey everyone,

We're excited to get started as one of the fifteen challengers in the "Music Tech Design Challenge"!

We will start our blog posts by sharing our initial proposal submitted for the contest.

nomad: a Generative Environmental Synthesizer

ashedBit: Alec Brady + Zach Howard

Overview

        The core concept behind the project is to utilize the BeagleBone Black to create a synthesizer which interacts and responds to input from our natural environment. Synthesizers typically exists in a studio landscape, with either a software or a tactilehardware human interface.These take many forms from eurorack modular systems to MIDI controlled drum machines, but rarely do they allow for our natural environment to interface and interact with their parameters. What if wind could determine tone colour? What if the humidity shaped the low pass filter? These are questions which we will address in our project: nomad. We aim to create an electronic instrument independant of the studio which will probe data sources such as weather, date, location and more to define it's signal path and sound parameters. In addition to shaping sound synthesis, these inputs will also control various effects and sequencers.

The result is an adaptive synthesizer based on variables of the natural world. It's sound and character defined by the environment, allowing for endless sonic combinations and possibilities.

About Us:

Alec Brady: Alec is a composer and programmer living in Toronto. He has created numerous Max/MSP and Ableton devices for clients including various large scale international tours. Currently, he is the organizer of Toronto's Ableton User Group and frequently hosts masterclasses and workshops covering music technology and audio synthesis. Portfolio: Max for Live — A/B Sound and Design

Zach Howard: Zach is a musician and experienced programmer also located in Toronto. His experience lies in building software synthesizers and other digital sound devices. Zach brings years of experience in server administration, web design and development to the projects he works on. http://www.zachhoward.me/

Development:

  The core design in our project will be taking advantage of the BeagleBone Black's sensory data as input values for the embedded sound engine. The device will also probe open APIs via tethered wifi using a smartphone, for other data such as GPS, precipitation etc. Given the wide range of sensors it may also be possible to integrate parameters such as spatial proximity, pressure and other tactile features. The device will be solar powered, allowing it to be taken out into nature for unique sound experiences. In addition to the environmental inputs, we also hope to integrate MIDI or OSC network-based user input. This will allow the user to add a keyboard, drum pads or send note messages over a network to the nomad.

We also hope to allow the project code to be easily accessible and allow users to create their own environmental systems and sound engines. The sound engine will be able to also perform traditional synthesizer tasks.We may also add the ability to process audio input through the system, allowing for the control of realtime input parameters by the environment. We would like the project to focus on user experience, with it to be approachable by musicians, performers and programmers alike.

Sound Engine:

The sound engine will run on a Linux based OS and likely be programmed using one of the following applications:

Csound: https://en.wikipedia.org/wiki/Csound

PureData: https://en.wikipedia.org/wiki/Pure_Data

SuperCollider: https://en.wikipedia.org/wiki/SuperCollider

We will need to first create a fully realized synthesizer, then determine which parameters will allow for external control. Our synthesizer will use a subtractive signal flow and include modules such as:

• Variable state resonant filter
• Oscillators(s) with variable waveshape including noise
• Mixer for multiple sound sources
• Multiple low frequency oscillators with variable waveshape up to audio range
• Envelopes for both filter and amplitude
• Sequencer or Arpeggiator with parameters such as gate length, rate, shape and scale
• Delay and reverb with parameters such as feedback, speed and dry/wet

In our initial planning, we will look to existing instruments which challenge digital instrument design such as the Yamaha Tenori-On, instruments by monome and the Theremin for inspiration.Yamaha Tenori On designer Toshio Iwai with a Tenori On-Whttps://en.wikipedia.org/wiki/Tenori-on Sensors and Data: Given the flexibility of the BeagleBone Black our options for data input are numerous. We would make great use of the components included in the challenger pack as almost all of them have direct implications with our project. Notably, the Allegro sensors the piezo transducer and photodiode as they would give nomad the ability to map its immediate environment. The greater number of materials at hand, the more possible feedback, thus the instrument will more effectively reflect its current environment.Here are some examples:

• Time of day
• Current date
• Humidity
• Elevation
• Temperature
• GPS
• Proximity
• Tilt sensor
• Wind speeds
• Light Levels
• Wind speeds
• 
  

When combined with the sound engine, these inputs facilitate complex modulation and sound generation. Here are some examples:

• Time of Day = Sequencer quantize scale
• Current Date = Sequencer root note
• Temperature = Oscillator 1 Wave shape (sine to square)
• Humidity = Oscillator 2 Wave shape (sine to square)
• Wind Speed = LFO rate
• Moon Cycle = LFO shape
  
• Tilt sensor = Delay Dry/Wet

Challenges:     While we have experience coding audio software and working with hardware, we have not yet had the opportunity to create an original hardware device. This project will allow us to explore new territory in hardware interfacing and design. It will push us to learn and implement our ideas into the real world via the BeagleBone and create a unique instrument in the process. Here are some challenges which are immediately apparent:

• Maintaining audio quality and relative practicality
• Interfacing with our external peripherals efficiently
• Ensuring minimal computational overhead (reducing latency)
• Constructing an enclosure which will withstand weather and travel
• Testing the device in climates and environments outside of our area
  
• Creating documentation and UX accessible to anyone

Conclusion:

    We feel our project will produce an instrument which explores the boundaries between digital music and our natural world. The nomad aims to encourage the exploration of not only sound but of the environment in which it is generated. We hope this relationship will encourage others to investigate with using other data inputs and sensors with the completed instrument. It will allow us the ability to learn the BeagleBone Black and the possibilities of its use in music technology.

Thank you.

Alec Brady

Zach Howard

Andrew McIntosh