发帖
雷达卡
摘要翻译：
提出了一种用于语音带宽扩展(BWE)的分层递归神经网络(HRNN)波形建模和生成方法。与传统的BWE方法预测频谱参数重构宽带语音波形不同，该方法不使用声码器，直接对波形样本进行建模和预测。受无条件神经音频发生器SampleRNN的启发，HRNN模型使用由长短时记忆(LSTM)层和前馈(FF)层组成的神经网络来表示每个宽带或高频波形样本在输入窄带波形样本条件下的分布。LSTM层形成分层结构，每一层以特定的时间分辨率操作，以有效地捕获时间序列之间的大跨度依赖关系。此外，利用基于深度神经网络(DNN)的状态分类器从窄带语音中提取瓶颈(BN)特征等附加条件作为辅助输入，进一步提高宽带语音的质量。实验结果表明，基于HRNN的波形建模方法比基于扩展卷积神经网络(DCNN)的方法和基于普通样本水平递归神经网络(SRNN)的方法具有更好的语音质量和运行效率。在重建宽带语音的主观质量方面，我们提出的方法也优于传统的基于声码器的基于LSTM-RNN的BWE方法。
---
英文标题：
《Waveform Modeling and Generation Using Hierarchical Recurrent Neural
Networks for Speech Bandwidth Extension》
---
作者：
Zhen-Hua Ling, Yang Ai, Yu Gu, Li-Rong Dai
---
最新提交年份：
2018
---
分类信息：
一级分类：Computer Science 计算机科学
二级分类：Sound 声音
分类描述：Covers all aspects of computing with sound, and sound as an information channel. Includes models of sound, analysis and synthesis, audio user interfaces, sonification of data, computer music, and sound signal processing. Includes ACM Subject Class H.5.5, and intersects with H.1.2, H.5.1, H.5.2, I.2.7, I.5.4, I.6.3, J.5, K.4.2.
涵盖了声音计算的各个方面，以及声音作为一种信息通道。包括声音模型、分析和合成、音频用户界面、数据的可听化、计算机音乐和声音信号处理。包括ACM学科类H.5.5，并与H.1.2、H.5.1、H.5.2、I.2.7、I.5.4、I.6.3、J.5、K.4.2交叉。
--
一级分类：Electrical Engineering and Systems Science 电气工程与系统科学
二级分类：Audio and Speech Processing 音频和语音处理
分类描述：Theory and methods for processing signals representing audio, speech, and language, and their applications. This includes analysis, synthesis, enhancement, transformation, classification and interpretation of such signals as well as the design, development, and evaluation of associated signal processing systems. Machine learning and pattern analysis applied to any of the above areas is also welcome. Specific topics of interest include: auditory modeling and hearing aids; acoustic beamforming and source localization; classification of acoustic scenes; speaker separation; active noise control and echo cancellation; enhancement; de-reverberation; bioacoustics; music signals analysis, synthesis and modification; music information retrieval; audio for multimedia and joint audio-video processing; spoken and written language modeling, segmentation, tagging, parsing, understanding, and translation; text mining; speech production, perception, and psychoacoustics; speech analysis, synthesis, and perceptual modeling and coding; robust speech recognition; speaker recognition and characterization; deep learning, online learning, and graphical models applied to speech, audio, and language signals; and implementation aspects ranging from system architecture to fast algorithms.
处理代表音频、语音和语言的信号的理论和方法及其应用。这包括分析、合成、增强、转换、分类和解释这些信号，以及相关信号处理系统的设计、开发和评估。机器学习和模式分析应用于上述任何领域也是受欢迎的。感兴趣的具体主题包括：听觉建模和助听器；声波束形成与声源定位；声场景分类；说话人分离；有源噪声控制和回声消除；增强；去混响；生物声学；音乐信号的分析、合成与修饰；音乐信息检索；多媒体音频和联合音视频处理；口语和书面语建模、切分、标注、句法分析、理解和翻译；文本挖掘；言语产生、感知和心理声学；语音分析、合成、感知建模和编码；鲁棒语音识别；说话人识别与特征描述；应用于语音、音频和语言信号的深度学习、在线学习和图形模型；以及从系统架构到快速算法的实现方面。
--
---
英文摘要：
This paper presents a waveform modeling and generation method using hierarchical recurrent neural networks (HRNN) for speech bandwidth extension (BWE). Different from conventional BWE methods which predict spectral parameters for reconstructing wideband speech waveforms, this BWE method models and predicts waveform samples directly without using vocoders. Inspired by SampleRNN which is an unconditional neural audio generator, the HRNN model represents the distribution of each wideband or high-frequency waveform sample conditioned on the input narrowband waveform samples using a neural network composed of long short-term memory (LSTM) layers and feed-forward (FF) layers. The LSTM layers form a hierarchical structure and each layer operates at a specific temporal resolution to efficiently capture long-span dependencies between temporal sequences. Furthermore, additional conditions, such as the bottleneck (BN) features derived from narrowband speech using a deep neural network (DNN)-based state classifier, are employed as auxiliary input to further improve the quality of generated wideband speech. The experimental results of comparing several waveform modeling methods show that the HRNN-based method can achieve better speech quality and run-time efficiency than the dilated convolutional neural network (DCNN)-based method and the plain sample-level recurrent neural network (SRNN)-based method. Our proposed method also outperforms the conventional vocoder-based BWE method using LSTM-RNNs in terms of the subjective quality of the reconstructed wideband speech.
---
PDF链接：
https://arxiv.org/pdf/1801.0791
京公网安备 11010802022788号
