Research in Sound and Auditory Perception

  • [2022] Constructive Accumulation: A Look at Self-Organizing Strategies for Aggregating Temporal Events along the Rhythm Timbre Continuum
    International Sound and Music Computing (SMC) Conference. Saint Etienne, France.
  • [2021] Beat Perception in the "Swarm": a look into tapping synchronization strategies using coupled metronomes
    Neurosciences and Music VII: Connecting Music across the Lifespan. Aarhus, Denmark.
  • [2020] Extracting beat from a crowd of coupled metronomes: effects of coupling strength and timbre
    International Conference on Music Perception and Cognition (ICMPC) Sheffield, UK
  • [2020] Menagerie: Exploring the audio-visual rhythms of violence through gun triggers, data, and swarms
    Sound and Music Computing Conference. Torino, Italy.
  • [2020] Sound Art and AI: About 'Engine Error / Self-Portrait'
    Oral Presentation at International Conference on Computational Creativity (ICCC). Coimbra, Portugal
  • [2019] Extracting beat from a crowd of loosely coupled, concurrent, periodic stimuli.
    Acoustical Society of America (ASA, San Diego, CA). The Predictive Brain Conference (Marseilles, France)
  • [2019] Kuroscillators: A Max MSP object for sound synthesis using coupled oscillators
    A paper summarizing a Max MSP and Faust implementation for real-time audio synthesis using coupled oscillators.
  • [2018] "BDSMR: Velcro as a Sensory Material and Erotic Interface
    Published in British Computer Society. This paper examines the sensory mechanics of the Velcro hook-and-loop fastener and its use as a sound object in contemporary sound-based art and the autonomous sensory meridian response (ASMR) community. With the neologism, BDSMR, I attempt to unpack the notion of velcro as a sound-fetish object by situating it within an emerging audio-visual culture, one that engages in cyborgian practices of sensory stimulation and optimizable arousal. Published by British Computer Journal in 2019.
  • [2019] Sound in Multiples: Synchrony and Interaction Design using Coupled Oscillator Networks
    Sound and Music Computing Conference. Malaga, Spain. Algorithmic design using self-synchronizing oscillators as a generative device for audio and rhythmic synthesis.
  • [2018] An Adaptive Model of Pulse in Jazz Percussion: Rhythmic Generation in Quasi-periodic Musical Contexts using Sequence-to-Sequence Learning
    Using a sequence-to-sequence LSTM neural network to infer and generate pulse using raw audio of solo jazz drumset recordings. This end to end model converts recordings into MIDI representation using a pre-trained RNN to do automatic drum transcription. This data is fed into an sequence-to-sequence LSTM network to create a real-time generative rhythm device.
  • [2017] SeismoDome: Sonic and visual representation of earthquakes and seismic waves
    Paper about the sonification and visualization of earthquake data at the Hayden Planetarium at the Museum of Natural History NYC.
  • [2017] A Generative Model of Pulse Percept: Analyzing Performances of Jazz Drumming using Dynamic Beat Tracking and Recurrent Neural Networks
    By analyzing audio recordings of a particular jazz drummer, this LSTM RNN takes as input beats as inferred by a dynamic beat tracking algorithm to learn a representation of a particular drummer's performance style.
  • [2016] Head Tracking Binaural Localization System for Horizontal Sound Source Detection
    This project attempted to reconstruct an inter- active spatialization auditory scene by using a head tracking sensor in conjunction with a binaural panning system imple- mented in the MaxMSP programming environment. This study was motivated by the need to be able to demonstrate in more informal settings–such as classroom demonstrations, or paper presentations–the general experimental environment that many researchers have used to examine the localization of point-like sound sources on the horizontal plane.
  • [2016] Phase Coherence as a Measure of Perceptual Synchrony in Large-Scale Coupled Oscillator Systems
    This experimental study looks at the way in which participants were able to determine the presence of an isochronous beat (rhythmic synchrony or congruence) using a coupled-oscillator model to generate competing auditory events. This mathematical model, Kuramoto oscillators, could be parameterized by varying the phase coherence and observing how well the participants were able to infer synchrony from a sequence of auditory stimuli.

    phase coherence as a measure of perceptual synchrony using kuramoto oscillators from Nolan Lem on Vimeo.

  • [2013] Functional Description of Custom Analog Modular Synthesizer
  • [2012] Data Sonification: Mutatis Mutandis, Synthesizing Sound with Glaciological and Atmostpheric Data
  • Material and Electrical Documentation