Exploration: Use 2 dimensional data as source for music generation

[oubiwann]

Use perlin/simplex noice to generate multiple "layers" to be used to control various (arbitrary) axes:

• pitch / velocity
• freq / resonance
• attack / delay
• sustain / release
• R/L balance
• Up/down positioning (binaural support)
• Chord progressions (could be done with banding / gradations)

That works for a single instrument at a time ... for every instrument, you could have different layers for the various attributes (big storage jump), or you could use the same layers for each instrument and just use values at different distances from a given point (i.e., a 2D ball -- in the formal maths sense -- around a given point to determine which instruments are played).

Papers of possible interest:

• See CONVERTING IMAGES TO MUSIC USING THEIR COLOUR PROPERTIES.

Depends on:

• Add gradient functions lfex/loise#36
• Implement a random walk scan through noise data lfex/loise#53
• Add support for finite data traversals lfex/loise#60
• Add support for infinite data traversals lfex/loise#65

Specific scenarios to explore:

• Map image data to velocity, send that as MIDI velocity
• Map graded image data to notes (e.g., in a scale, across a range of octaves), send that as a MIDI pitch
• Panning will be trickier:
  • first, maybe build up something in Element that receives MIDI CC and controls the volume
  • then figure out what CC to send in order to control said volume
  • coordinate these CC codes to lower and raise volumes of L & R to emulate panning