Remark slides

class: center, middle, ircam

# Web Audio Plugins

## Guillaume Pellerin - Head Web Team (POW) @IRCAM

<hr>

### Creative Music Technologies for Learning and Play Meetup - IRCAM - 26/02/2020

---
class: ircam

# Why WAPs?

<hr>

- dynamic loading of remote objects into the Web Audio API context
- autonomous Web Audio components (processor, controller, GUI, states, event, URI)
- support various plugin source approaches

.pull-left[
<img src="img/worldDominationPlan4.png" width="500px">
]

.pull-right[
*WAP: Ideas for a Web Audio Plug-in Standard*, Michel Buffa, Jerome Lebrun, Jari Kleimola, Oliver Larkin, Guillaume Pellerin, Stéphane Letz, Proc. of Web Audio Conference 2018, TU Berlin - <a href="https://www.webaudioconf.com/_data/papers/pdf/2018/2018_22.pdf">PDF</a>

]

---
class: ircam

# Web Audio Plugin API

<hr>

.pull-left[
## First draft version targets

- Host/plug-in Model
- Events and MIDI
- Parameters, Persistence
- Plug-in Files
- User Interfaces
]

.pull-right[
## Concepts

- a WAP extends AudioNode (or AudioWorkletNode)
- WAPs are either composite or custom audio nodes
- WAP metadata is available as a separate JSON file
- a WAP endpoint is described by a URI
- works mainly on Chrome (FireFox soon)
]

https://github.com/micbuffa/WebAudioPlugins

---
class: ircam

# Online Tools, Tutorials and Examples

<hr>

- Builder aka WAP FAUST Editor
  - https://mainline.i3s.unice.fr/fausteditorweb/dist/
- Testers
  - https://wasabi.i3s.unice.fr/WebAudioPluginBank/testers/test2.html
  - https://wasabi.i3s.unice.fr/WebAudioPluginBank/testers/explorandtest.html
- Patcher aka dynamicPedalboard
  - https://wasabi.i3s.unice.fr/dynamicPedalboard/
- Explorer & Player aka WASABI
  - http://wasabi.i3s.unice.fr/

---
class: ircam, tight

# WASABI Project

<hr>

## WASABI = Web Audio Semantic Aggregated in the Browser for Indexation

- the construction of a 2 million song knowledge base that combines semantic metadata and audio metadata collected from music databases on the Web,
- semantic applications based on a semantic API and database,
- audio applications based on an audio processing API and database,
- interactive WebAudio applications linked to the Wasabi database.

It is a 42-month project founded by the French National Agency for Research (ANR contract ANR-16-CE23-0017-01).

## Usecases

- musicology
- music learning / teaching
- composing
- data journalism

http://wasabihome.i3s.unice.fr/

---
class: ircam

# WASABI Project Architecture

<hr>

---
class: ircam

# Perpectives

<hr>

- MIDI I/O
- Better event management + time
- Juce2WAP direct compiler
- pedalBoard > open web app patcher
- Endomorphism (plugin as a patch)
- Better (mimetic) learning experience with online automatic demixing tools (WASABI 2)
- Web based generative processing based on remote static and live audio and semantic data (WASABI 2)

---
class: center, middle, ircam

# Enjoy and have FUN!

<hr>

### Guillaume Pellerin / @yomguy / guillaume.pellerin@ircam.fr

---
class: center, middle, ircam

# Meetup Paris Audio + Creative Code Paris

https://www.meetup.com/fr-FR/Paris-Audio/

https://www.meetup.com/fr-FR/CreativeCodeParis

Event main reference :

https://www.meetup.com/fr-FR/CreativeCodeParis/events/268771084/