Skip to main navigation Skip to search Skip to main content

Text to speech synthesis using deep learning

  • Rabbia Mahum*
  • , Aun Irtaza
  • , Ali Javed
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Chapter › peer-review

6 Scopus citations

Abstract

The audio deep fake is a process to generate speech similar to some specific people using various methods from text utterances of natural language. The task of speech synthesis is challenging due to the unavailability of any general model that can generate speech from all existing languages. Therefore, in this chapter, we analyze the existing techniques for Text-To-Speech (TTS) synthesis considering their architecture. Moreover, we propose a novel TTS synthesizer based on a deep learning model i.e. encoder, decoder, synthesizer, combined with a reward block based on Reinforcement Learning (RL). To the best of our knowledge, our proposed synthesizer is the first TTS synthesizer that can generate speeches in three natural languages such as English, Chinese, and French. Furthermore, we performed an experiment based on Mean Opinion Scale (MOS) which showed that our proposed model is an efficient technique for TTS synthesis.

Original languageEnglish
Title of host publicationIntelligent Multimedia Signal Processing for Smart Ecosystems
PublisherSpringer International Publishing
Pages289-305
Number of pages17
ISBN (Electronic)9783031348730
ISBN (Print)9783031348723
DOIs
StatePublished - 30 Sep 2023
Externally publishedYes

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2023.

Keywords

  • Deep learning
  • Reinforcement learning
  • TTS detection
  • TTS synthesis

ASJC Scopus subject areas

  • General Computer Science
  • General Mathematics

Fingerprint

Dive into the research topics of 'Text to speech synthesis using deep learning'. Together they form a unique fingerprint.

Cite this