##Python audio processing framework and server made for the web
-###Guillaume Pellerin, Antoine Grandry, Martin Desrumaux - POW - IRCAM
+###Guillaume Pellerin, Antoine Grandry, Martin Desrumaux - POW (Web Team), IRCAM
+
#### Séminaire STMS - 14/10/2020 - IRCAM
#Outline
-- Intro (GP 2mn)
-- History (GP 5mn)
-- Core (GP 10mn)
-- Server (AG 10mn)
-- Player v2 (MD 10mn)
-- Perspectives (GP 3mn)
+- Intro (GP)
+- History (GP)
+- Core (GP)
+- Server (AG)
+- Player v2 (MD)
+- Perspectives (GP)
---
- more data sets, databases, formats, algorithm versions, open DSP libraries & communities
- collaborative workflows, citizen sciences through the web
-## Problems, needs and usecases
+## Constraints and usecases
- computer science need human data, digital humanities needs computers
-- difficult to port and scale some algorithms on streaming platforms (DSP at scale)
-- copyrighted data
- reproducible research
- sustainable digital archiving
+- difficult to port and scale some algorithms on production platforms (DSP at scale)
+- copyrighted data
- open source and standards
- format evolution and abstraction
- duplicate and version everything
]
-
---
-class: ircam, tight
+class: ircam
#WASABI project
- INRIA (I3S)
- IRCAM (APM, AnaSyn, POW)
+- Parisson
- Deezer R&D
- Radio France
-- Parisson
---
##Objectives
- Propose some new methodologies to index music in the web and audio contexts
-- Link semantics (linked metadata) + acoustics (MIR data) + machine learning
+- Link semantics (linked metadata) + acoustics (MIR data)
- Develop and publish some open source web services through original APIs
##Use cases
---
class: ircam
-# WASABI platform
+# WASABI platform architecture
+
+.pic-container[
+ <img src="img/Architecture_WASABI.png" width="70%">
+]
+
+---
+class: ircam
+# WASABI platform ([link](https://wasabi.i3s.unice.fr/))
.pic-container[
- <img src="img/Architecture_WASABI.png" width="80%">
+ <img src="img/wasabi.i3s.unice.fr-ledzep-2.png" width="100%">
]
- Collaborative annotation
- Audio web services
-##License AGPL v2
+##License: AGPL v2
---
class: ircam
- processing API
- plugin architecture
- namespace
-- docker packaged
- ~500 unit tests
+- docker packaged
]
.pull-right-70[
```bash
$ git clone --recursive https://github.com/Parisson/TimeSide.git
+$ docker-compose run app python3 manage.py shell
$ docker-compose up
```
+https://timeside.readthedocs.io/en/latest/index.html
+
]
---
-class: ircam, tight
+class: ircam
# timeside.core
---
-class: ircam, tight
+class: ircam
# timeside.core
## What's new?
-0.9.4 > 1.0.0a (released yesterday!): 674 commits, 7 contributors
+###0.9.4 > 1.0.0a (released yesterday! 🎉 )
+* 674 commits, 7 contributors
* Python 2.7 to 3.7
* Drop GStreamer for Aubio as default decoder and encoder
* Regroup all dependencies on pip requirements, drop conda
* Add `Provider` object
* Add Provider plugins `deezer-preview`, `deezer-complete` and `youtube`
* Add loggers
-* Improve Docker packaging
+* Improve Docker packaging and image building
---
class: ircam, middle, center, inverse
.pull-right[
-<img src="img/architecture_WASABI-providers.png" width="450">
+<img src="img/Architecture_WASABI-providers.png" width="450">
<!-- .right[] -->
]
.pull-right[
-<img src="img/architecture_WASABI-server.png" width="450">
+<img src="img/Architecture_WASABI-server.png" width="450">
<!-- .right[] -->
]
.pull-right[
-<img src="img/architecture_WASABI-deezer.png" width="450">
+<img src="img/Architecture_WASABI-deezer.png" width="450">
<!-- .right[] -->
]
.pull-right[
-<img src="img/architecture_WASABI-frontend.png" width="450">
+<img src="img/Architecture_WASABI-frontend.png" width="450">
<!-- .right[] -->
]
- Clustering and orchestration (Kubernetes)
- Implementing Websocket, ServerEvent or Webhook to avoid task status polling
-- Split repositories : core, server, player
-- Documentation, notebooks
-- More tests
+- Split repositories : core / server / player
+- More documentation, notebooks and tests
###Use cases
-- MIRchiving (Telemeta 2, CMS embedding, BNF, UNAM, UNESCO)
-- Metadata enhanced streaming services (Spotify, Deezer, SoundCloud, Netflix)
+- MIRchiving (Telemeta 2, CMS embedding, MNHN, UNAM, UNESCO)
- Digitization and media packaging services (VectraCom, VDM, Gecko)
+- Metadata enhanced streaming services (Spotify, Deezer, SoundCloud, Netflix)
###Dual licencing
---
class: center, middle, ircam, inverse
-# Merci !
-
-##Guillaume Pellerin, Antoine Grandry, Martin Desrumaux - IRCAM, France
+# Thank you and kudos to all contributors!
<img src="img/wasabi_logo_darkbg.png" height="75px" />
-###guillaume.pellerin@ircam.fr / @yomguy / @telemeta
-
-
----
-class: ircam, tight
-
-#Other TimeSide related projects
-
-- DIADEMS
-- DaCaRyh (Labex) - Steel band history
- - C4DM : Centre for Digital Music at Queen Mary University (London, UK)
- - CREM
- - Parisson
-- NYU / CREM - Arabic rythm analysis
- - NYU : New York University
- - CREM
- - Parisson
-- KAMoulox (ANR) - audio source separation
- - INRIA
- - Parisson
- - http://kamoulox.telemeta.org/
- - http://kamoulox.telemeta.org/timeside/api/results/
+###guillaume.pellerin@ircam.fr / @yomguy