- -

Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems

RiuNet: Repositorio Institucional de la Universidad Politécnica de Valencia

Compartir/Enviar a

Citas

Estadísticas

  • Estadisticas de Uso

Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems

Mostrar el registro sencillo del ítem

Ficheros en el ítem

dc.contributor.author Alonso-Jordá, Pedro es_ES
dc.contributor.author Cortina, Raquel es_ES
dc.contributor.author Rodríguez-Serrano, F.J. es_ES
dc.contributor.author Vera-Candeas, P. es_ES
dc.contributor.author Alonso-González, M. es_ES
dc.contributor.author Ranilla, José es_ES
dc.date.accessioned 2020-10-17T03:32:39Z
dc.date.available 2020-10-17T03:32:39Z
dc.date.issued 2017-01 es_ES
dc.identifier.issn 0920-8542 es_ES
dc.identifier.uri http://hdl.handle.net/10251/152274
dc.description.abstract [EN] The Audio-to-Score framework consists of two separate stages: pre- processing and alignment. The alignment is commonly solved through offline Dynamic Time Warping (DTW), which is a method to find the path over the distortion matrix with the minimum cost to determine the relation between the performance and the musical score times. In this work we propose a par- allel online DTW solution based on a client-server architecture. The current version of the application has been implemented for multi-core architectures (x86, x64 and ARM), thus covering either powerful systems or mobile devices. An extensive experimentation has been conducted in order to validate the software. The experiments also show that our framework allows to achieve a good score alignment within the real-time window by using parallel computing techniques. es_ES
dc.description.sponsorship This work has been partially supported by Spanish Ministry of Science and Innovation and FEDER under Projects TEC2012-38142-C04-01, TEC2012-38142-C04-03, TEC2012-38142-C04-04, TEC2015-67387-C4-1-R, TEC2015-67387-C4-3-R, TEC2015-67387-C4-4-R, the European Union FEDER (CAPAP-H5 network TIN2014-53522-REDT), and the Generalitat Valenciana under Grant PROMETEOII/2014/003. es_ES
dc.language Inglés es_ES
dc.publisher Springer-Verlag es_ES
dc.relation.ispartof The Journal of Supercomputing es_ES
dc.rights Reserva de todos los derechos es_ES
dc.subject Audio-to-Score Alignment es_ES
dc.subject Dynamic Time Warping (DTW) es_ES
dc.subject Score Following es_ES
dc.subject Parallel Computing es_ES
dc.subject Xeon Phi es_ES
dc.subject ARM es_ES
dc.subject.classification CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL es_ES
dc.title Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems es_ES
dc.type Artículo es_ES
dc.identifier.doi 10.1007/s11227-016-1647-5 es_ES
dc.relation.projectID info:eu-repo/grantAgreement/MINECO//TEC2015-67387-C4-3-R/ES/SMART SOUND PROCESSING FOR THE DIGITAL LIVING: SMART COMPUTING/ es_ES
dc.relation.projectID info:eu-repo/grantAgreement/MINECO//TEC2015-67387-C4-1-R/ES/SMART SOUND PROCESSING FOR THE DIGITAL LIVING/ es_ES
dc.relation.projectID info:eu-repo/grantAgreement/MINECO//TEC2012-38142-C04-01/ES/PROCESADO DISTRIBUIDO Y COLABORATIVO DE SEÑALES SONORAS: CONTROL ACTIVO/ es_ES
dc.relation.projectID info:eu-repo/grantAgreement/MINECO//TEC2012-38142-C04-03/ES/PROCESADO DISTRIBUIDO Y COLABORATIVO DE SEÑALES SONORAS: INTERPRETACION DE MUSICA EN DIRECTO./ es_ES
dc.relation.projectID info:eu-repo/grantAgreement/MINECO//TEC2012-38142-C04-04/ES/PROCESADO DISTRIBUIDO Y COLABORATIVO DE SEÑALES SONORAS: COMPUTACION DISTRIBUIDA/ es_ES
dc.relation.projectID info:eu-repo/grantAgreement/MINECO//TEC2015-67387-C4-4-R/ES/SMART SOUND PROCESSING FOR THE DIGITAL LIVING: COGNITIVE LISTENING/ es_ES
dc.relation.projectID info:eu-repo/grantAgreement/MINECO//TIN2014-53522-REDT/ES/RED DE COMPUTACION DE ALTAS PRESTACIONES EN ARQUITECTURAS HETEROGENEAS (CAPAP-H5)/ es_ES
dc.relation.projectID info:eu-repo/grantAgreement/GVA//PROMETEOII%2F2014%2F003/ES/Computación y comunicaciones de altas prestaciones y aplicaciones en ingeniería/ es_ES
dc.rights.accessRights Abierto es_ES
dc.contributor.affiliation Universitat Politècnica de València. Departamento de Sistemas Informáticos y Computación - Departament de Sistemes Informàtics i Computació es_ES
dc.description.bibliographicCitation Alonso-Jordá, P.; Cortina, R.; Rodríguez-Serrano, F.; Vera-Candeas, P.; Alonso-González, M.; Ranilla, J. (2017). Parallel Online Time Warping for Real-Time Audio-to-Score Alignment in Multi-core Systems. The Journal of Supercomputing. 73(1):126-138. https://doi.org/10.1007/s11227-016-1647-5 es_ES
dc.description.accrualMethod S es_ES
dc.relation.publisherversion https://doi.org/10.1007/s11227-016-1647-5 es_ES
dc.description.upvformatpinicio 126 es_ES
dc.description.upvformatpfin 138 es_ES
dc.type.version info:eu-repo/semantics/publishedVersion es_ES
dc.description.volume 73 es_ES
dc.description.issue 1 es_ES
dc.relation.pasarela S\299619 es_ES
dc.contributor.funder Generalitat Valenciana es_ES
dc.contributor.funder European Regional Development Fund es_ES
dc.contributor.funder Ministerio de Economía y Competitividad es_ES
dc.description.references Joder C, Essid S, Richard G (2011) A conditional random field framework for robust and scalable audio-to-score matching. IEEE Trans Speech Audio Lang Process 19(8):2385–2397 es_ES
dc.description.references McNab RJ, Smith LA, Witten IH, Henderson CL, Cunningham SJ (1996) Towards the digital music library: tune retrieval from acoustic input. In: DL 96: Proceedings of the first ACM international conference on digital libraries. ACM, New York, pp 11–18 es_ES
dc.description.references Dannenberg RB (2007) An intelligent multi-track audio editor. In: Proceedings of international computer music conference (ICMC), vol 2, pp 89–94 es_ES
dc.description.references Duan Z, Pardo B (2011) Soundprism: an online system for score-informed source separation of music audio. IEEE J Sel Topics Signal Process 5(6):1205–1215 es_ES
dc.description.references Dixon S (2005) Live tracking of musical performances using on-line time warping. In: Proceedings of the international conference on digital audio effects (DAFx), Madrid, Spain, pp 92–97 es_ES
dc.description.references Orio N, Schwarz D (2001) Alignment of monophonic and polyphonic music to a score. In: Proceedings of the international computer music conference (ICMC), pp 129–132 es_ES
dc.description.references Simon I, Morris D, Basu S (2008) MySong: automatic accompaniment generation for vocal melodies. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, New York, pp 725–734 es_ES
dc.description.references Rodriguez-Serrano FJ, Duan Z, Vera-Candeas P, Pardo B, Carabias-Orti JJ (2015) Online score-informed source separation with adaptive instrument models. J New Music Res Lond 44(2):83–96 es_ES
dc.description.references Arzt A, Widmer G, Dixon S (2008) Automatic page turning for musicians via real-time machine listening. In: Proceedings of the 18th European conference on artificial intelligence. IOS Press, Amsterdam, pp 241–245 es_ES
dc.description.references Carabias-Orti JJ, Rodriguez-Serrano FJ, Vera-Candeas P, Canadas-Quesada FJ, Ruiz-Reyes N (2015) An audio to score alignment framework using spectral factorization and dynamic time warping. In: 16th International Society for music information retrieval conference, pp 742–748 es_ES
dc.description.references Rodríguez-Serrano FJ, Menéndez-Canal J, Vidal A, Cañadas-Quesada FJ, Cortina R (2015) A DTW based score following method for score-informed sound source separation. In: Proceedings of the 12th sound and music computing conference 2015 (SMC-15), Ireland, pp 491–496 es_ES
dc.description.references Carabias-Ortí JJ, Rodríguez-Serrano FJ, Vera-Candeas P, Cañadas-Quesada FJ, Ruíz-Reyes N (2013) Constrained non-negative sparse coding using learnt instrument templates for realtime music transcription. Eng Appl Artif Intell 26(7):1671–1680 es_ES
dc.description.references Raphael C (2006) Aligning music audio with symbolic scores using a hybrid graphical model. Mach Learn 65:389–409 es_ES
dc.description.references Schreck-Ensemble (2001–2004) ComParser 1.42. http://home.hku.nl/~pieter.suurmond/SOFT/CMP/doc/cmp.html . Accessed Sept 2015 es_ES
dc.description.references Itakura F (1975) Minimum prediction residual principle applied to speech recognition. IEEE Trans Acoust Speech Signal Process 23:52–72 es_ES
dc.description.references Dannenberg R, Hu N (2003) Polyphonic audio matching for score following and intelligent audio editors. In: Proceedings of the international computer music conference. International Computer Music Association, San Francisco, pp 27–34 es_ES
dc.description.references Mueller M, Kurth F, Roeder T (2004) Towards an efficient algorithm for automatic score-to-audio synchronization. In: Proceedings of the 5th international conference on music information retrieval, Barcelona, Spain es_ES
dc.description.references Mueller M, Mattes H, Kurth F (2006) An efficient multiscale approach to audio synchronization. In: Proceedings of the 7th international conference on music information retrieval, Victoria, Canada es_ES
dc.description.references Kaprykowsky H, Rodet X (2006) Globally optimal short-time dynamic time warping applications to score to audio alignment. In: IEEE ICASSP, Toulouse, France, pp 249–252 es_ES
dc.description.references Fremerey C, Müller M, Clausen M (2010) Handling repeats and jumps in score-performance synchronization. In: Proceedings of ISMIR, pp 243–248 es_ES
dc.description.references Arzt A, Widmer G (2010) Towards effective any-time music tracking. In: Proceedings of starting AI researchers symposium (STAIRS), Lisbon, Portugal, pp 24–36 es_ES


Este ítem aparece en la(s) siguiente(s) colección(ones)

Mostrar el registro sencillo del ítem