Classification and Retrieval of Multimedia Audio Learning Resources
DOI:
https://doi.org/10.3991/ijet.v18i20.44221Keywords:
multimedia audio learning resources, construction of a classification model, resource retrieval, self-similarity matrix filtering, feature representationAbstract
With the development of the Internet and new media, multimedia and audio learning resources have been widely used in teaching and learning. However, their classification and retrieval have become important and urgent issues to be addressed. This study conducted in-depth research on the classification system, construction, and retrieval of multimedia audio learning resources, with the aim of solving several problems with existing research methods, such as timeconsuming manual labeling, inconsistent labeling, and traditional retrieval methods neglecting the correlation between audio and metadata. First, a classification model of audio learning resources was constructed. It processed single-mode data from audios and annotated texts and further abstracted the single-mode information into high-level feature vectors. Then the complementarity between multi-modalities was used to fuse the abstract features or decisionmaking results and eliminate information redundancy between modalities, thereby learning a better feature representation of multimedia audio learning resources. Second, a retrieval method for the resources based on self-similarity matrix filtering was proposed, which aimed to improve the accuracy and efficiency of retrieval. This study provides a new theoretical and practical perspective for classifying and retrieving multimedia audio learning resources.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Nan Zhang (Submitter); Wenwen Zhang
This work is licensed under a Creative Commons Attribution 4.0 International License.
The submitting author warrants that the submission is original and that she/he is the author of the submission together with the named co-authors; to the extend the submission incorporates text passages, figures, data or other material from the work of others, the submitting author has obtained any necessary permission.
Articles in this journal are published under the Creative Commons Attribution Licence (CC-BY What does this mean?). This is to get more legal certainty about what readers can do with published articles, and thus a wider dissemination and archiving, which in turn makes publishing with this journal more valuable for you, the authors.
By submitting an article the author grants to this journal the non-exclusive right to publish it. The author retains the copyright and the publishing rights for his article without any restrictions.