mirror of
https://github.com/eliasstepanik/strudel-docker.git
synced 2026-01-11 13:48:34 +00:00
more citations
This commit is contained in:
parent
829a794df7
commit
80bd3be0a1
@ -639,6 +639,7 @@
|
||||
{"id":"ngMusicMotionTransdomain2004","abstract":"This paper presents a framework called Music via Motion (MvM) designed for the transdomain mapping between physical movements of the performer(s) and multimedia events, translating activities from one creative domain to another-for example, from physical gesture to audio output. With a brief background of this domain and prototype designs, the paper describes a number of inter- and multidisciplinary collaborative works for interactive multimedia performances. These include a virtual musical instrument interface, exploring video-based tracking technology to provide an intuitive and nonintrusive musical interface, and sensor-based augmented instrument designs. The paper also describes a distributed multimedia-mapping server which allows multiplatform and multisensory integrations and presents a sample application which integrates a real-time face tracking system. Ongoing developments and plausible future explorations on stage augmentation with virtual and augmented realities as well as gesture analysis on the correlations of musical gesture and physical gesture are also discussed.","author":[{"family":"Ng","given":"K. C."}],"citation-key":"ngMusicMotionTransdomain2004","container-title":"Proceedings of the IEEE","DOI":"10.1109/jproc.2004.825885","ISSN":"0018-9219","issue":"4","issued":{"date-parts":[[2004,4]]},"page":"645–655","title":"Music via motion: transdomain mapping of motion and sound for interactive performances","type":"article-journal","URL":"http://dx.doi.org/10.1109/jproc.2004.825885","volume":"92"},
|
||||
{"id":"nisbettTellingMoreWe1977","abstract":"Evidence is reviewed which suggests that there may be little or no direct introspective access to higher order cognitive processes. Subjects are sometimes (a) unaware of the existence of a stimulus that importantly influenced a response, (b) unaware of the existence of the response, and (c) unaware that the stimulus has affected the response. It is proposed that when people attempt to report on their cognitive processes, that is, on the processes mediating the effects of a stimulus on a response, the do not do so on the basis of any true introspection. Instead, their reports are based on a priori, implicit casual theories or judgments about the extent to which a particular stimulus is a plausible cause of a given response. This suggests that though people may not be able to observe directly their cognitive processes, the will sometimes be able to report accurately about them. Accurate reports will occur when influential stimuli are salient and are plausible causes of the responses they produce, and will not occur the stimuli are not salient or are not plausible causes.","author":[{"family":"Nisbett","given":"Richard E."},{"family":"Wilson","given":"Timothy D."}],"citation-key":"nisbettTellingMoreWe1977","container-title":"Psychological Review","editor":[{"family":"Devivo","given":"Anita"},{"family":"Silver","given":"Amy"},{"family":"Felder","given":"Deborah S."},{"family":"Hayward","given":"Robert J."},{"family":"Patterson","given":"Kendall C."},{"family":"Redman","given":"Anne"},{"family":"Buchwald","given":"Alexander"},{"family":"Falmagne","given":"Rachel J."},{"family":"Krantz","given":"David H."},{"family":"Olson","given":"Gary M."},{"family":"Shiffrin","given":"Richard M."},{"family":"Smith","given":"Edward E."},{"family":"Theios","given":"John"},{"family":"Wiggins","given":"Jerry S."}],"issue":"3","issued":{"date-parts":[[1977,5]]},"note":"Published: Not available electronically","title":"Telling More Than We Can Know: Verbal Reports on Mental Processes","type":"article-journal","volume":"84"},
|
||||
{"id":"novelloPerceptualEvaluationMusic2006","author":[{"family":"Novello","given":"Alberto"},{"family":"McKinney","given":"Martin F."},{"family":"Kohlrausch","given":"Armin"}],"citation-key":"novelloPerceptualEvaluationMusic2006","container-title":"Proceedings of the Seventh Annual In- ternational Symposium on Music Information Retrieval: ISMIR 2006","issued":{"date-parts":[[2006]]},"title":"Perceptual evaluation of music similarity","type":"article-journal"},
|
||||
{"id":"ogbornDktr0WebDirt2022","abstract":"Sampling engine implemented in Web Audio API (rough re-creation of Dirt)","accessed":{"date-parts":[[2022,6,24]]},"author":[{"family":"Ogborn","given":"David"}],"citation-key":"ogbornDktr0WebDirt2022","genre":"JavaScript","issued":{"date-parts":[[2022,6,12]]},"original-date":{"date-parts":[[2016,5,4]]},"source":"GitHub","title":"dktr0/WebDirt","type":"book","URL":"https://github.com/dktr0/WebDirt"},
|
||||
{"id":"ogbornEstuaryBrowserbasedCollaborative2017","abstract":"This paper describes the initial design and development of Estuary, a browser-based collaborative projectional editing environment built on top of the popular TidalCycles language for the live coding of musical pattern. Key features of Estuary include a strict form of structure editing (making syntactical errors impossible), a click-only border-free approach to interface design, explicit notations to modulate the liveness of different parts of the code, and a server-based network collaboration system that can be used for many simultaneous collaborative live coding performances, as well as to present different views of the same live coding activity. Estuary has been developed using Reflex-DOM, a Haskell-based framework for web development whose strictness promises robustness and security advantages.","author":[{"family":"Ogborn","given":"David"},{"family":"Beverley","given":"Jamie"},{"family":"Navarro del Angel","given":"Luis"},{"family":"Tsabary","given":"Eldad"},{"family":"McLean","given":"Alex"}],"citation-key":"ogbornEstuaryBrowserbasedCollaborative2017","container-title":"Proceedings of the International Conference on Live Coding","event":"ICLC2017","event-place":"Morelia","issued":{"date-parts":[[2017]]},"language":"en","page":"11","publisher-place":"Morelia","source":"Zotero","title":"Estuary: Browser-based Collaborative Projectional Live Coding of Musical Patterns","type":"paper-conference"},
|
||||
{"id":"ogbornExtramurosMakingMusic2015","author":[{"family":"Ogborn","given":"David"},{"family":"Tsabary","given":"Eldad"},{"family":"Jarvis","given":"Ian"},{"family":"Cardenas","given":"Alexandra"},{"family":"McLean","given":"Alex"}],"citation-key":"ogbornExtramurosMakingMusic2015","container-title":"Proceedings of the First International Conference on Live Coding, University of Leeds, ICSRiM","issued":{"date-parts":[[2015]]},"title":"Extramuros: making music in a browser-based, language-neutral collaborative live coding environment","type":"paper-conference"},
|
||||
{"id":"ogbornLiveCodingScalable2014","abstract":"Live coding (Collins et al. 2003 and other articles in this special issue of Computer Music Journal) is the central performance practice of the Cybernetic Orchestra, a laptop orchestra at McMaster University in Hamilton, Ontario, Canada. Inspired by the idea of participatory culture, the ensemble has been made open to a diverse and ever changing roster of participants, and may be likened to a human laboratory exploring this question: How is live coding scalable onto larger groups of people coming from diverse backgrounds? This article presents the practices that have developed during the first three years of the Cybernetic Orchestra's existence, starting with a summary of our human organization and physical infrastructure. The EspGrid software, developed for enhanced network synchronization and sharing, is reviewed before a final section presents the live coding practices that have crystallized around this specific collective of people, equipment, and code.","author":[{"family":"Ogborn","given":"David"}],"citation-key":"ogbornLiveCodingScalable2014","container-title":"Computer Music Journal","DOI":"10.1162/comj_a_00217","issue":"1","issued":{"date-parts":[[2014,3]]},"page":"17–30","title":"Live Coding in a Scalable, Participatory Laptop Orchestra","type":"article-journal","URL":"http://dx.doi.org/10.1162/comj_a_00217","volume":"38"},
|
||||
@ -815,6 +816,7 @@
|
||||
{"id":"stringfellowDerivingChangeArchitectures2004","author":[{"family":"Stringfellow","given":"C."},{"family":"Amory","given":"C. D."},{"family":"Potnuri","given":"D."},{"family":"Georg","given":"M."},{"family":"Andrews","given":"A."}],"citation-key":"stringfellowDerivingChangeArchitectures2004","issued":{"date-parts":[[2004]]},"number-of-pages":"210+","title":"Deriving change architectures from RCS history","type":"book"},
|
||||
{"id":"stroopStudiesInterferenceSerial1935","author":[{"family":"Stroop","given":"J. R."}],"citation-key":"stroopStudiesInterferenceSerial1935","container-title":"Journal of Experimental Psychology","issue":"6","issued":{"date-parts":[[1935]]},"title":"Studies of interference in serial verbal reactions.","type":"article-journal","volume":"18"},
|
||||
{"id":"sundbergMusicalSignificanceMusicians1994","author":[{"family":"Sundberg","given":"J."}],"citation-key":"sundbergMusicalSignificanceMusicians1994","container-title":"Phonetica","issue":"51","issued":{"date-parts":[[1994]]},"page":"132–145","title":"Musical significance of musicians' syllable choice in improvized nonsense-text singing. A preliminary study","type":"article-journal","volume":"1-3"},
|
||||
{"id":"SuperDirt2022","abstract":"Tidal Audio Engine","accessed":{"date-parts":[[2022,6,24]]},"citation-key":"SuperDirt2022","genre":"SuperCollider","issued":{"date-parts":[[2022,6,24]]},"original-date":{"date-parts":[[2015,11,3]]},"publisher":"musikinformatik","source":"GitHub","title":"SuperDirt","type":"book","URL":"https://github.com/musikinformatik/SuperDirt"},
|
||||
{"id":"sutton-spenceLinguisticsBritishSign1999","abstract":"This is the first textbook dealing specifically with British sign linguistics. It provides essential support for learners of British Sign Language and others interested in the structure and use of BSL, and assumes no previous knowledge of linguistics and sign language. Technical terms and linguistic jargon are kept to a minimum. The book contains over three hundred illustrations and an index of signs and sign phrases. There are also exercises and a reading list for further independent study.","author":[{"family":"Sutton-Spence","given":"Rachel"},{"family":"Woll","given":"Bencie"}],"citation-key":"sutton-spenceLinguisticsBritishSign1999","ISBN":"0-521-63718-X","issued":{"date-parts":[[1999,3]]},"note":"Published: Paperback","publisher":"Cambridge University Press","title":"The Linguistics of British Sign Language: An Introduction","type":"book","URL":"http://www.worldcat.org/isbn/052163718X"},
|
||||
{"id":"SweetAnticipation","accessed":{"date-parts":[[2017,10,23]]},"citation-key":"SweetAnticipation","container-title":"MIT Press","title":"Sweet Anticipation","type":"webpage","URL":"https://mitpress.mit.edu/books/sweet-anticipation"},
|
||||
{"id":"szaboAnfaengeGriechischenMathematik1969","abstract":"Gerade heute, wo sich die Aufmerksamkeit der führenden Philosophen, Logiker und Mathematiker erneut auf die Grundlagen der systematisch-deduktiven Mathematik richtet, ist dieses Buch von zeitnaher und tiefer Bedeutung.","author":[{"family":"Szabo","given":"Arpad"}],"citation-key":"szaboAnfaengeGriechischenMathematik1969","edition":"Reprint 2015","event-place":"München","ISBN":"978-3-486-47201-1","issued":{"date-parts":[[1969,12,1]]},"language":"Deutsch","number-of-pages":"494","publisher":"De Gruyter Oldenbourg","publisher-place":"München","source":"Amazon","title":"Anfänge der griechischen Mathematik","type":"book"},
|
||||
|
||||
@ -144,6 +144,39 @@ Here is a short description of all the functions used:
|
||||
instrument
|
||||
- `pianoroll()`: visualize events as midi notes in a pianoroll
|
||||
|
||||
# Ways to make Sound
|
||||
|
||||
To generate sound, Strudel supports different outputs:
|
||||
|
||||
- Tone.js
|
||||
- Web Audio API
|
||||
- WebDirt, a js recreation of Tidal's *Dirt* sample engine
|
||||
- OSC via osc-js
|
||||
- MIDI via WebMIDI
|
||||
|
||||
Tone.js proved to be limited for the use case of Strudel, where each
|
||||
individual event could potentially have a completely different audio
|
||||
graph. While the Web Audio API takes a *fire-and-forget* approach,
|
||||
creating a lot of Tone.js instruments and effects causes performance
|
||||
issues quickly. For that reason, we chose to search for alternatives.
|
||||
|
||||
Strudel's Web Audio API output creates a new audio graph for each event.
|
||||
It currently supports basic oscillators, sample playback, envelopes,
|
||||
filters and an experimental support for soundfonts.
|
||||
|
||||
WebDirt [@ogbornDktr0WebDirt2022] was created as part of the Estuary
|
||||
Live Coding System [@ogbornEstuaryBrowserbasedCollaborative2017], and
|
||||
proved to be a solid choice for handling samples in Strudel as well.
|
||||
|
||||
Using OSC, it is possible to send messages to SuperDirt
|
||||
[@SuperDirt2022], which is what Tidal does to generate sound. The
|
||||
downside of using OSC is that it requires the user to install
|
||||
SuperCollider and its sc3plugins library, which can be difficult.
|
||||
|
||||
The MIDI output can be used to send MIDI messages to either external
|
||||
instruments or to other programs on the same device. Web MIDI is
|
||||
currently only supported on chromium-based browsers.
|
||||
|
||||
# Future Outlook
|
||||
|
||||
The project is still young, with many features on the horizon. As
|
||||
@ -153,17 +186,10 @@ general guiding principles, Strudel aims to be
|
||||
2. consistent with Tidal's approach to pattern
|
||||
3. modular and extensible
|
||||
|
||||
The main accessibility advantage over Tidal is the zero install browser
|
||||
environment. It should also now be accessible to screen reader users,
|
||||
with the recent integration of the CodeMirror 6 editor. While Strudel
|
||||
can control Tidal's SuperDirt audio system via OSC, that requires the
|
||||
user to install SuperCollider and its sc3plugins library, which can be
|
||||
difficult. Without SuperDirt, Strudel is able to output sound itself via
|
||||
Tone.js, however this is limited both in terms of available features and
|
||||
runtime performance. For the future, it is planned to integrate
|
||||
alternative sound engines such as glicol [@lanChaosprintGlicol2022] and
|
||||
faust [@FaustProgrammingLanguage2022]. To improve compatibility with
|
||||
Tidal, more Tidal functions are planned to be ported, as well as full
|
||||
For the future, it is planned to integrate alternative sound engines
|
||||
such as glicol [@lanChaosprintGlicol2022] and faust
|
||||
[@FaustProgrammingLanguage2022]. To improve compatibility with Tidal,
|
||||
more Tidal functions are planned to be ported, as well as full
|
||||
compatibility with SuperDirt. Besides sound, other ways to render events
|
||||
are being explored, such as graphical, and choreographic output. We are
|
||||
also looking into alternative ways of editing patterns, including
|
||||
|
||||
BIN
paper/demo.pdf
BIN
paper/demo.pdf
Binary file not shown.
Loading…
x
Reference in New Issue
Block a user