From c79c39d0c2d6c3da55baba26f96e52d015bb9586 Mon Sep 17 00:00:00 2001 From: Thomas Fillon Date: Mon, 27 Oct 2014 18:55:13 +0100 Subject: [PATCH] submitted version --- Conferences/2015_WAC/submission.rst | 59 ++++++++++++++++++++++------- 1 file changed, 46 insertions(+), 13 deletions(-) diff --git a/Conferences/2015_WAC/submission.rst b/Conferences/2015_WAC/submission.rst index 79a1ec1..a04955a 100644 --- a/Conferences/2015_WAC/submission.rst +++ b/Conferences/2015_WAC/submission.rst @@ -5,8 +5,8 @@ .. Title is evocative and short. If in doubt, keep it brief and descriptive. -The Telemeta and TimeSide plateforms: Audio archives management and Automatic anlysis. - +The Telemeta platform and TimeSide framework: Audio archives management and Automatic analysis. + ============ Topic(s) * ============ @@ -41,20 +41,53 @@ Please select one or more topics for your talk - How or did you improve your web app or library based on user feedback ? -Since 2007, the Parisson company have been developping Telemeta, an open-source web audio framework for the management of and access to digital sound archives. +Telemeta isan open-source web audio platform for the management and access to digital sound archives and audio metadata. It is developed by the Parisson company and other open source developers since 2007. + +Telemeta focuses on the enhanced and collaborative user-experience in accessing audio items and their associated metadata and on the possibility forthe expert users to further enrich those metadata though hierarchical and structured fields, thesaurus and ontologies. + +This platform has been deployed since 2011 in the context of ethnomusicological archives and hold the archives of the Center for Research in Ethnomusicology, which is the most important ethnic music collection in Europe. The platform is fully operational and is now used on a daily basis by researchers, teachers and archivists in the fields of ethnomusicology, anthropology, linguistics and acoustics. + +The Telemeta audio engine relies on TimeSide, an open audio processing framework written in Python and JavaScript. +Not only TimeSide provides Telemeta with audio decoding, encoding and streaming methods but with a set of on-the-fly signal analysis methods as well. +Given these low and high level signal analysis capabilities, various audio signal representations can be computed and incorporated in the embedded HTML audio player. + +By additionally wrapping several audio features extraction libraries,various automatic annotation, segmentation and musicological analysis can be performed over the audio archives and metadata. -It focuses on the enhanced and collaborative user-experience in accessing audio items and their associated metadata and on the possibility for -the expert users to further enrich those metadata. +The TimeSide engine architecture is composed of several modules and makes it easy to develop and add new plugins. -This platform has been deployed since 2011 in the context of ethnomusicological archives and hold the archives of the Center for Research in Ethnomusicology, which is the most important collection in Europe. The platform is fully operational and is now used on a daily basis by reasearchers, teachers and archivists in the fields of Ethnomusicology, anthropology, linguistics and acoustics. +Through collaboration with academic research labs in computer science, speech processing and music information retrieval, new automatic analysis functionalities are brought to the platform regularly. -One of the specificity of the Telemeta architecture is to rely on TimeSide, an open audio processing framework written in Python which provides decoding, -encoding and streaming methods for various formats together with a smart embeddable HTML audio player. -TimeSide also includes a set of audio analysis plugins and additionally wraps several audio features extraction libraries to provide automatic -annotation, segmentation and musicological analysis. +As component of a fully functional but continuously evolving web platform, the development of both Telemeta and TimeSide is secured with unitary testing process. -The Telemeta and TimeSide platform are available as open-source projects at the following adresses: +The Telemeta and TimeSide platform are available as open-source projects at the following addresses: + - Telemeta: https://github.com/yomguy/Telemeta + - TimeSide: https://github.com/yomguy/TimeSide + +Questions/answers: + + - What already existed (equivalent libraries or web app, native app or desktop ones) ? + + Equivalent web app such as FreeSound, SoundCloud, P2P apps and many desktop softwares (SonicVisualiser, ELAN, Esonoclaste, etc.) already existed but there was no open source collaborative audio web application which also provides a rich support of metadata with database capabilities. + + So Telemeta has been started. + + - What was your specific needs ? + + We needed a good web object oriented framework for developing (Django), a fast and smart transcoding, streaming and analyzing audio engine (TimeSide), then a good use case with original music data (CREM) + +- What is new with your approach, and why this approach fits your needs ? + + We decided to build a platform with on-demand and on-the-fly processing so that the service can be scaled and improved over time and usage. + + - How did you use web standards (especially Web Audio API) ? + + Telemeta templates are fully written in HTML5. Interactions with the API use JSON or XML RPC. The TimeSide player uses SoundManager2 which wraps the Web Audio API with some control and fallback methods. + + - How or did you improve your web app or library based on user feedback ? + + Bug trackers are used on telemeta.org and GitHub by the developers and the users to debug and define new functions or metadata classes. + + Some research missions have also engaged some studies about the use of the CREM's platform. These missions have emerged some special usecases in the fields of learning, research and museology for example. + -Telemeta: https://github.com/yomguy/Telemeta -TimeSide: https://github.com/yomguy/TimeSide -- 2.39.5