more citations

This commit is contained in:
alex 2022-06-24 22:40:13 +01:00
parent 829a794df7
commit 80bd3be0a1
3 changed files with 39 additions and 11 deletions

View File

@ -639,6 +639,7 @@
{"id":"ngMusicMotionTransdomain2004","abstract":"This paper presents a framework called Music via Motion (MvM) designed for the transdomain mapping between physical movements of the performer(s) and multimedia events, translating activities from one creative domain to another-for example, from physical gesture to audio output. With a brief background of this domain and prototype designs, the paper describes a number of inter- and multidisciplinary collaborative works for interactive multimedia performances. These include a virtual musical instrument interface, exploring video-based tracking technology to provide an intuitive and nonintrusive musical interface, and sensor-based augmented instrument designs. The paper also describes a distributed multimedia-mapping server which allows multiplatform and multisensory integrations and presents a sample application which integrates a real-time face tracking system. Ongoing developments and plausible future explorations on stage augmentation with virtual and augmented realities as well as gesture analysis on the correlations of musical gesture and physical gesture are also discussed.","author":[{"family":"Ng","given":"K. C."}],"citation-key":"ngMusicMotionTransdomain2004","container-title":"Proceedings of the IEEE","DOI":"10.1109/jproc.2004.825885","ISSN":"0018-9219","issue":"4","issued":{"date-parts":[[2004,4]]},"page":"645655","title":"Music via motion: transdomain mapping of motion and sound for interactive performances","type":"article-journal","URL":"http://dx.doi.org/10.1109/jproc.2004.825885","volume":"92"},
{"id":"nisbettTellingMoreWe1977","abstract":"Evidence is reviewed which suggests that there may be little or no direct introspective access to higher order cognitive processes. Subjects are sometimes (a) unaware of the existence of a stimulus that importantly influenced a response, (b) unaware of the existence of the response, and (c) unaware that the stimulus has affected the response. It is proposed that when people attempt to report on their cognitive processes, that is, on the processes mediating the effects of a stimulus on a response, the do not do so on the basis of any true introspection. Instead, their reports are based on a priori, implicit casual theories or judgments about the extent to which a particular stimulus is a plausible cause of a given response. This suggests that though people may not be able to observe directly their cognitive processes, the will sometimes be able to report accurately about them. Accurate reports will occur when influential stimuli are salient and are plausible causes of the responses they produce, and will not occur the stimuli are not salient or are not plausible causes.","author":[{"family":"Nisbett","given":"Richard E."},{"family":"Wilson","given":"Timothy D."}],"citation-key":"nisbettTellingMoreWe1977","container-title":"Psychological Review","editor":[{"family":"Devivo","given":"Anita"},{"family":"Silver","given":"Amy"},{"family":"Felder","given":"Deborah S."},{"family":"Hayward","given":"Robert J."},{"family":"Patterson","given":"Kendall C."},{"family":"Redman","given":"Anne"},{"family":"Buchwald","given":"Alexander"},{"family":"Falmagne","given":"Rachel J."},{"family":"Krantz","given":"David H."},{"family":"Olson","given":"Gary M."},{"family":"Shiffrin","given":"Richard M."},{"family":"Smith","given":"Edward E."},{"family":"Theios","given":"John"},{"family":"Wiggins","given":"Jerry S."}],"issue":"3","issued":{"date-parts":[[1977,5]]},"note":"Published: Not available electronically","title":"Telling More Than We Can Know: Verbal Reports on Mental Processes","type":"article-journal","volume":"84"},
{"id":"novelloPerceptualEvaluationMusic2006","author":[{"family":"Novello","given":"Alberto"},{"family":"McKinney","given":"Martin F."},{"family":"Kohlrausch","given":"Armin"}],"citation-key":"novelloPerceptualEvaluationMusic2006","container-title":"Proceedings of the Seventh Annual In- ternational Symposium on Music Information Retrieval: ISMIR 2006","issued":{"date-parts":[[2006]]},"title":"Perceptual evaluation of music similarity","type":"article-journal"},
{"id":"ogbornDktr0WebDirt2022","abstract":"Sampling engine implemented in Web Audio API (rough re-creation of Dirt)","accessed":{"date-parts":[[2022,6,24]]},"author":[{"family":"Ogborn","given":"David"}],"citation-key":"ogbornDktr0WebDirt2022","genre":"JavaScript","issued":{"date-parts":[[2022,6,12]]},"original-date":{"date-parts":[[2016,5,4]]},"source":"GitHub","title":"dktr0/WebDirt","type":"book","URL":"https://github.com/dktr0/WebDirt"},
{"id":"ogbornEstuaryBrowserbasedCollaborative2017","abstract":"This paper describes the initial design and development of Estuary, a browser-based collaborative projectional editing environment built on top of the popular TidalCycles language for the live coding of musical pattern. Key features of Estuary include a strict form of structure editing (making syntactical errors impossible), a click-only border-free approach to interface design, explicit notations to modulate the liveness of different parts of the code, and a server-based network collaboration system that can be used for many simultaneous collaborative live coding performances, as well as to present different views of the same live coding activity. Estuary has been developed using Reflex-DOM, a Haskell-based framework for web development whose strictness promises robustness and security advantages.","author":[{"family":"Ogborn","given":"David"},{"family":"Beverley","given":"Jamie"},{"family":"Navarro del Angel","given":"Luis"},{"family":"Tsabary","given":"Eldad"},{"family":"McLean","given":"Alex"}],"citation-key":"ogbornEstuaryBrowserbasedCollaborative2017","container-title":"Proceedings of the International Conference on Live Coding","event":"ICLC2017","event-place":"Morelia","issued":{"date-parts":[[2017]]},"language":"en","page":"11","publisher-place":"Morelia","source":"Zotero","title":"Estuary: Browser-based Collaborative Projectional Live Coding of Musical Patterns","type":"paper-conference"},
{"id":"ogbornExtramurosMakingMusic2015","author":[{"family":"Ogborn","given":"David"},{"family":"Tsabary","given":"Eldad"},{"family":"Jarvis","given":"Ian"},{"family":"Cardenas","given":"Alexandra"},{"family":"McLean","given":"Alex"}],"citation-key":"ogbornExtramurosMakingMusic2015","container-title":"Proceedings of the First International Conference on Live Coding, University of Leeds, ICSRiM","issued":{"date-parts":[[2015]]},"title":"Extramuros: making music in a browser-based, language-neutral collaborative live coding environment","type":"paper-conference"},
{"id":"ogbornLiveCodingScalable2014","abstract":"Live coding (Collins et al. 2003 and other articles in this special issue of Computer Music Journal) is the central performance practice of the Cybernetic Orchestra, a laptop orchestra at McMaster University in Hamilton, Ontario, Canada. Inspired by the idea of participatory culture, the ensemble has been made open to a diverse and ever changing roster of participants, and may be likened to a human laboratory exploring this question: How is live coding scalable onto larger groups of people coming from diverse backgrounds? This article presents the practices that have developed during the first three years of the Cybernetic Orchestra's existence, starting with a summary of our human organization and physical infrastructure. The EspGrid software, developed for enhanced network synchronization and sharing, is reviewed before a final section presents the live coding practices that have crystallized around this specific collective of people, equipment, and code.","author":[{"family":"Ogborn","given":"David"}],"citation-key":"ogbornLiveCodingScalable2014","container-title":"Computer Music Journal","DOI":"10.1162/comj_a_00217","issue":"1","issued":{"date-parts":[[2014,3]]},"page":"1730","title":"Live Coding in a Scalable, Participatory Laptop Orchestra","type":"article-journal","URL":"http://dx.doi.org/10.1162/comj_a_00217","volume":"38"},
@ -815,6 +816,7 @@
{"id":"stringfellowDerivingChangeArchitectures2004","author":[{"family":"Stringfellow","given":"C."},{"family":"Amory","given":"C. D."},{"family":"Potnuri","given":"D."},{"family":"Georg","given":"M."},{"family":"Andrews","given":"A."}],"citation-key":"stringfellowDerivingChangeArchitectures2004","issued":{"date-parts":[[2004]]},"number-of-pages":"210+","title":"Deriving change architectures from RCS history","type":"book"},
{"id":"stroopStudiesInterferenceSerial1935","author":[{"family":"Stroop","given":"J. R."}],"citation-key":"stroopStudiesInterferenceSerial1935","container-title":"Journal of Experimental Psychology","issue":"6","issued":{"date-parts":[[1935]]},"title":"Studies of interference in serial verbal reactions.","type":"article-journal","volume":"18"},
{"id":"sundbergMusicalSignificanceMusicians1994","author":[{"family":"Sundberg","given":"J."}],"citation-key":"sundbergMusicalSignificanceMusicians1994","container-title":"Phonetica","issue":"51","issued":{"date-parts":[[1994]]},"page":"132145","title":"Musical significance of musicians' syllable choice in improvized nonsense-text singing. A preliminary study","type":"article-journal","volume":"1-3"},
{"id":"SuperDirt2022","abstract":"Tidal Audio Engine","accessed":{"date-parts":[[2022,6,24]]},"citation-key":"SuperDirt2022","genre":"SuperCollider","issued":{"date-parts":[[2022,6,24]]},"original-date":{"date-parts":[[2015,11,3]]},"publisher":"musikinformatik","source":"GitHub","title":"SuperDirt","type":"book","URL":"https://github.com/musikinformatik/SuperDirt"},
{"id":"sutton-spenceLinguisticsBritishSign1999","abstract":"This is the first textbook dealing specifically with British sign linguistics. It provides essential support for learners of British Sign Language and others interested in the structure and use of BSL, and assumes no previous knowledge of linguistics and sign language. Technical terms and linguistic jargon are kept to a minimum. The book contains over three hundred illustrations and an index of signs and sign phrases. There are also exercises and a reading list for further independent study.","author":[{"family":"Sutton-Spence","given":"Rachel"},{"family":"Woll","given":"Bencie"}],"citation-key":"sutton-spenceLinguisticsBritishSign1999","ISBN":"0-521-63718-X","issued":{"date-parts":[[1999,3]]},"note":"Published: Paperback","publisher":"Cambridge University Press","title":"The Linguistics of British Sign Language: An Introduction","type":"book","URL":"http://www.worldcat.org/isbn/052163718X"},
{"id":"SweetAnticipation","accessed":{"date-parts":[[2017,10,23]]},"citation-key":"SweetAnticipation","container-title":"MIT Press","title":"Sweet Anticipation","type":"webpage","URL":"https://mitpress.mit.edu/books/sweet-anticipation"},
{"id":"szaboAnfaengeGriechischenMathematik1969","abstract":"Gerade heute, wo sich die Aufmerksamkeit der führenden Philosophen, Logiker und Mathematiker erneut auf die Grundlagen der systematisch-deduktiven Mathematik richtet, ist dieses Buch von zeitnaher und tiefer Bedeutung.","author":[{"family":"Szabo","given":"Arpad"}],"citation-key":"szaboAnfaengeGriechischenMathematik1969","edition":"Reprint 2015","event-place":"München","ISBN":"978-3-486-47201-1","issued":{"date-parts":[[1969,12,1]]},"language":"Deutsch","number-of-pages":"494","publisher":"De Gruyter Oldenbourg","publisher-place":"München","source":"Amazon","title":"Anfänge der griechischen Mathematik","type":"book"},

View File

@ -144,6 +144,39 @@ Here is a short description of all the functions used:
instrument
- `pianoroll()`: visualize events as midi notes in a pianoroll
# Ways to make Sound
To generate sound, Strudel supports different outputs:
- Tone.js
- Web Audio API
- WebDirt, a js recreation of Tidal's *Dirt* sample engine
- OSC via osc-js
- MIDI via WebMIDI
Tone.js proved to be limited for the use case of Strudel, where each
individual event could potentially have a completely different audio
graph. While the Web Audio API takes a *fire-and-forget* approach,
creating a lot of Tone.js instruments and effects causes performance
issues quickly. For that reason, we chose to search for alternatives.
Strudel's Web Audio API output creates a new audio graph for each event.
It currently supports basic oscillators, sample playback, envelopes,
filters and an experimental support for soundfonts.
WebDirt [@ogbornDktr0WebDirt2022] was created as part of the Estuary
Live Coding System [@ogbornEstuaryBrowserbasedCollaborative2017], and
proved to be a solid choice for handling samples in Strudel as well.
Using OSC, it is possible to send messages to SuperDirt
[@SuperDirt2022], which is what Tidal does to generate sound. The
downside of using OSC is that it requires the user to install
SuperCollider and its sc3plugins library, which can be difficult.
The MIDI output can be used to send MIDI messages to either external
instruments or to other programs on the same device. Web MIDI is
currently only supported on chromium-based browsers.
# Future Outlook
The project is still young, with many features on the horizon. As
@ -153,17 +186,10 @@ general guiding principles, Strudel aims to be
2. consistent with Tidal's approach to pattern
3. modular and extensible
The main accessibility advantage over Tidal is the zero install browser
environment. It should also now be accessible to screen reader users,
with the recent integration of the CodeMirror 6 editor. While Strudel
can control Tidal's SuperDirt audio system via OSC, that requires the
user to install SuperCollider and its sc3plugins library, which can be
difficult. Without SuperDirt, Strudel is able to output sound itself via
Tone.js, however this is limited both in terms of available features and
runtime performance. For the future, it is planned to integrate
alternative sound engines such as glicol [@lanChaosprintGlicol2022] and
faust [@FaustProgrammingLanguage2022]. To improve compatibility with
Tidal, more Tidal functions are planned to be ported, as well as full
For the future, it is planned to integrate alternative sound engines
such as glicol [@lanChaosprintGlicol2022] and faust
[@FaustProgrammingLanguage2022]. To improve compatibility with Tidal,
more Tidal functions are planned to be ported, as well as full
compatibility with SuperDirt. Besides sound, other ways to render events
are being explored, such as graphical, and choreographic output. We are
also looking into alternative ways of editing patterns, including

Binary file not shown.