Upgrade to Pro — share decks privately, control downloads, hide ads and more …

[ASRU 2021] Multi-stream HiFi-GAN with data-driven waveform decomposition

Takuma OKAMOTO
December 21, 2021

[ASRU 2021] Multi-stream HiFi-GAN with data-driven waveform decomposition

T. Okamoto, T. Toda and H. Kawai,
"Multi-stream HiFi-GAN with data-driven waveform decomposition,"
in Proc. ASRU, Dec. 2021, pp. 610–617.
https://asru2021.org

Synthesized speech demo samples:
https://ast-astrec.nict.go.jp/demo_samples/asru_2021_okamoto/index.html

Takuma OKAMOTO

December 21, 2021
Tweet

More Decks by Takuma OKAMOTO

Other Decks in Research

Transcript

  1. Multi-stream HiFi-GAN with data-driven waveform decomposition Takuma Okamoto1, Tomoki Toda2,1,

    and Hisashi Kawai1 1National Institute of Information and Communications Technology (NICT), Japan 2Nagoya University, Japan 1
  2. Introduction HiFi-GAN and Multi-band MelGAN neural vocoders Investigation of upsampling

    layers Proposed methods Multi-stream Mel-GAN Multi-stream HiFi-GAN Experiments Entire real-time neural TTS systems on CPUs 
 with Parallel Tacotron 2 with forced alignment Conclusions Speech demo samples available online Outline 2 <latexit sha1_base64="5bv/Fn8RI0HR6kR253f7wpLXIZY=">AAACdHichVHLSsNAFD2N7/po1I2gi2KouLFMq6i4Ety4EeqjWqhSkjjW0MmDZFrQ4g/4Ay5cKRYRP8ONP+DCTxCXFd248DYNiIp6w2TOnLnnzpm5hiesQDL2GFM6Oru6e3r74v0Dg0MJdXhkO3Crvsnzpitcv2DoAReWw/PSkoIXPJ/rtiH4jlFZae3v1LgfWK6zJY88vmfrZcc6sExdElVSE2tczAQeN6Xvln3dLqkaS7Mwkj9BJgIaosi56jV2sQ8XJqqwweFAEhbQEdBXRAYMHnF7qBPnE7LCfY4TxElbpSxOGTqxFfqXaVWMWIfWrZpBqDbpFEHDJ2USKfbAbliT3bNb9sTef61VD2u0vBzRbLS13CslTsc23/5V2TRLHH6q/vQscYDF0KtF3r2Qad3CbOtrx2fNzaWNVH2KXbJn8n/BHtkd3cCpvZiNdb5xjjg1IPP9uX+C7Ww6M5+eXc9qy3NRK3oxjklM03svYBmryCEf9uQcV2jEXpUJRVNS7VQlFmlG8SWU9AejXJAn</latexit> Mel-spectrogram <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="W5aXXoObO7pbNXY1fkTBIq6f4go=">AAACfHichVHLSsNAFD2Nr1ofrbpQcFOsFUEtk6pVuiq4cemrVailJHHahqZJSNJCLf6AP+DClYqIqF/hxh9w4SeIywpuRLxNA6JFvcPMnDlzz50zM7KpqbbD2JNP6Oru6e3z9wcGBoeGg6GR0YxtVC2FpxVDM6w9WbK5puo87aiOxvdMi0sVWeO7cnmttb9b45atGvqOUzd5riIVdbWgKpJDVD40XuaWzrVkeGU+rJQk3cXLYjwfirAYcyPcCUQPRODFhhG6wj4OYEBBFRVw6HAIa5BgU8tCBINJXA4N4ixCqrvPcYQAaauUxSlDIrZMY5FWWY/Vad2qabtqhU7RqFukDCPKHtk1a7IHdsOe2fuvtRpujZaXOs1yW8vNfPB4YvvtX1WFZgelL9Wfnh0UsOp6Vcm76TKtWyhtfe3wpLmd3Io2Ztg5eyH/Z+yJ3dMN9NqrcrnJt04RoA8Qfz53J8jEY2IitrgZj6SWvK/wYxJTmKX3XkEK69hA2j33Are4830I08KcsNBOFXyeZgzfQkh8Amx5ka4=</latexit> kernel: 7, channel: 512 <latexit sha1_base64="k8bMMz392/OeCXGAjAEN/0B0y5A=">AAACdXichVG7SgNBFD1ZXzG+Vm0EEYJRsYqzKipWARsLC40mChrC7jqJS/bF7iQQQ37AH7DQRiGK+Bk2/oCFnyCWCmksvNksiAb1DjNz5sw9d87MaK5p+IKx54jU1d3T2xftjw0MDg2PyKNjWd8pezrP6I7peAea6nPTsHlGGMLkB67HVUsz+b5W2mjt71e45xuOvSeqLs9ZatE2CoauCqLyslw70grxLa6WqvE038rU83KCJVkQ8U6ghCCBMLYd+RZHOIYDHWVY4LAhCJtQ4VM7hAIGl7gcasR5hIxgn6OOGGnLlMUpQyW2RGORVocha9O6VdMP1DqdYlL3SBnHLHtid+yNPbJ79sI+fq1VC2q0vFRp1tpa7uZHziZ2m/+qLJoFTr5Uf3oWKGAt8GqQdzdgWrfQ2/rK6fnb7np6tjbHrtkr+b9iz+yBbmBX3vXGDk9fIEYfoPx87k6QXUwqK8mlneVEajn8iigmMY15eu9VpLCJbWTo3Aou0cBNpClNSTPSXDtVioSacXwLaeETPIGP6w==</latexit> LeakyReLU <latexit sha1_base64="4W8kVIAFDYKqxJRx+bHFCFn2NAg=">AAACdnichVHLSsNAFD2N7/po1Y0gSLFUXZVbLSquBDcutVoVrJQkTjWYJiGZ1kfoD/gDLsSFghbxM9z4Ay78BHGpoAsX3qYBUVHvMDNnztxz58yM5piGJ4keIkpLa1t7R2dXtLunty8W7x9Y8+yKq4u8bpu2u6GpnjANS+SlIU2x4bhCLWumWNf2Fhr761XheoZtrcpDR2yV1R3LKBm6KpkqxvsLUhxI3y9opYRUrd1arRhPUpqCSPwEmRAkEcaSHa+jgG3Y0FFBGQIWJGMTKjxum8iA4DC3BZ85l5ER7AvUEGVthbMEZ6jM7vG4w6vNkLV43ajpBWqdTzG5u6xMIEX3dE3PdEc39Ejvv9bygxoNL4c8a02tcIqx46GV139VZZ4ldj9Vf3qWKGE28GqwdydgGrfQm/rq0cnzylwu5Y/RBT2x/3N6oFu+gVV90S+XRe4UUf6AzPfn/gnWJtOZ6fTUcjY5nw2/ohPDGMUEv/cM5rGIJeT53H2c4Qr1yJsyoqSU8WaqEgk1g/gSCn0AG36RSw==</latexit> tanh <latexit sha1_base64="DyyzWJsU+/UDYnrzOZlHdxaANSc=">AAACdXichVHLSsNAFD2Nr1pfUTeCCMWquKpTFRVXghuXfRhbUClJnNZgXiRpQEN/wB9woRuFKuJnuPEHXPgJ4rKCGxfepAFRUW/IzJkz99x7Zkaxdc31GHtKCF3dPb19yf7UwODQ8Ig4OrbjWg1H5ZJq6ZZTUWSX65rJJU/zdF6xHS4bis7LytFmuF/2ueNqlrntHdt835DrplbTVNkjqiqKwZ5SS0u2KxvUzqw3q2KGZVkU6Z8gF4MM4shb4g32cAALKhowwGHCI6xDhkvfLnJgsInbR0CcQ0iL9jmaSJG2QVmcMmRij2is02o3Zk1ahzXdSK1SF51+h5RpzLJHdsva7IHdsWf2/mutIKoRejmmWelouV0dOZ0ovf2rMmj2cPip+tOzhxrWIq8aebcjJjyF2tH7J2ft0npxNphjV+yF/F+yJ3ZPJzD9V7VV4MVzpOgBct+v+yfYWczmVrJLhcXMxnL8FElMYhrzdN+r2MAW8pCor48LtHCdeBOmhBlhrpMqJGLNOL6EsPABowmQmw==</latexit> Upsampling <latexit sha1_base64="wNZ9eSoQI7ZL2wpRp6ZdgmqvoBI=">AAACfXichVHLSsNAFD2Nr1ofrboR3BRLxYWWaRUrrgQ3LuujWmxLSdJpHZomIUkLtegH+AMuXCmKiOhPuPEHXPgJ4lLBjaA3aUBU1DvMzJkz99w5M6OYmrAdxh4CUld3T29fsD80MDg0HI6MjG7ZRsNSeVY1NMPKKbLNNaHzrCMcjedMi8t1RePbSm3F3d9ucssWhr7ptExerMtVXVSEKjtElSLj7YJSie5wy5jNyOWy0KuzbrnyfikSYwnmRfQnSPogBj8yRuQCBZRhQEUDdXDocAhrkGFTyyMJBpO4ItrEWYSEt8+xjxBpG5TFKUMmtkZjlVZ5n9Vp7da0PbVKp2jULVJGEWf37JI9szt2xR7Z26+12l4N10uLZqWj5WYpfDi+8fqvqk6zg91P1Z+eHVSw6HkV5N30GPcWakff3Dt63lhaj7en2Cl7Iv8n7IHd0g305ot6vsbXjxGiD0h+f+6fYCuVSC4k5tZSseV5/yuCmMAkpum901jGKjLI0rkHOMM1bgLvUlyakRKdVCnga8bwJaT0BycCk3s=</latexit> Zero-Padding-based <latexit sha1_base64="3S73na9z9RiLMTbUigJC38BMVGs=">AAACe3ichVHNSsNAEP4a/+tfVRDBS7AoIqVMarXqSfDiUVurgkpJ4lZD0yQkaaFWX8AX8OBJQUT0Lbz4Ah58BPGo4EXBaRoRD9VZdnfm2/lmv93RHNPwfKKniNTW3tHZ1d0T7e3rHxiMDQ1venbF1UVet03b3dZUT5iGJfK+4Zti23GFWtZMsaWVVhrnW1XheoZtbfg1R+yV1QPLKBq66jNUiI2WhGsJc0men03I+qFqBYFSiMUpuUiLaSKZkhQYO2lKZVKKrIRIHKGt2bFr7GIfNnRUUIaABZ99Eyo8HjtQQHAY20OdMZc9IzgXOEGUuRXOEpyhMlri9YCjnRC1OG7U9AK2zreYPF1mypikR7qhV3qgW3qmj5a16kGNhpYa71qTK5zC4OlY7v1fVpl3H4c/rD81+yhiIdBqsHYnQBqv0Jv86tHZa24pO1mfokt6Yf0X9ET3/AKr+qZfrYvsOaLcgO9flls7m6mkMp+cXU/Fl9NhK7oxjglM839nsIxVrCHP9x7jEre4i3xKcWlGSjRTpUjIGcEvk+a+AB40kZU=</latexit> kernel: 63, channel: 1 <latexit sha1_base64="CDfnGanWxP3iN5b9GeONSPbQgjA=">AAACeXichVHLSgMxFD0d3/VVHwvBTbVUiouSqqi4Ety4rNY+QKXMTFMNzouZtNAWf8AfcOFGBZHqZ7jxB1z4CeJSwYUuvJ0OiBb1hiQnJ/fcnCSaYwhPMvYYUrq6e3r7+gfCg0PDI6ORsfGcZ1dcnWd127DdgqZ63BAWz0ohDV5wXK6amsHz2tFGaz9f5a4nbGtH1hy+b6oHligLXZVEFSOTmZolD7kn6rwUzatVXrZdsxiJsSTzI9oJUgGIIYi0HbnGHkqwoaMCExwWJGEDKjxqu0iBwSFuHw3iXELC3+c4Rpi0FcrilKESe0TjAa12A9aidaum56t1OsWg7pIyijh7YE32wu7ZLXtiH7/Wavg1Wl5qNGttLXeKoydTmbd/VSbNEodfqj89S5Sx6nsV5N3xmdYt9La+Wj99yaxtxxtz7JI9k/8L9sju6AZW9VW/2uLbZwjTB6R+PncnyC0kU8vJxa2F2PpS8BX9mMYsEvTeK1jHJtLI0rl1nKOJm9C7MqMklPl2qhIKNBP4FsriJ6JSkmg=</latexit> Synthesized Waveform <latexit sha1_base64="2ubV1qqnZXRUSZXlGfdk7joEZEY=">AAACgHichVE9TxtBEH1cIIAhwYEGieYUy4gmzpxjAXZlyU1KG8eABMi6u6zJivXd6T6sEMsFLX+AggokhCIa8hvS8AdS8BMiSpBoUmTufAhRkMxqd2ffzJt9O2t5SgYh0fWI9mJ07OX4xGRmavrV65nsm9n1wI18W7RsV7n+pmUGQklHtEIZKrHp+cLsWkpsWHu1OL7RE34gXedTuO+Jna6568iOtM2QoXZ2ob9tdfRmZL3z5Feh9Jrr9FwVxcFBO5ujQpnKJSKdCpQYOyUqrhQN3UiRHFKru9lzbOMzXNiI0IWAg5B9BRMBjy0YIHiM7aDPmM+eTOICA2SYG3GW4AyT0T1ed/m0laIOn+OaQcK2+RbF02emjjz9ou90S1d0Qb/pz7O1+kmNWMs+79aQK7z2zOF88/6/rC7vIb48sv6pOUQHq4lWydq9BIlfYQ/5vW9Ht83KWr6/SKd0w/pP6Jp+8guc3p191hBrx8jwBzx0WX/eWS8WjOXCh0YxVy2lXzGBBbzFEvd7BVV8RB0tvvcA57jED03TlrT3mjFM1UZSzhyemFb5C+pXlEk=</latexit> Sub-pixel Convolution <latexit sha1_base64="DdwdgvMaDN83VKPAOwTtDdmQY0g=">AAACl3ichVHNSiNBEP4cddWsu0a9uHgZDMoeltCJv+SiIIhHo0YFI2FmthMbZ3qG6U5QQ17AF1DwpCCL+A5ePOgLePARxKMLXjxYmQyIirvVdHf1V/VVfd1tB65QmrG7NqO9o/NLV3dP4mvvt+99yf6BNeVXQ4cXHN/1ww3bUtwVkhe00C7fCEJuebbL1+2d+WZ8vcZDJXy5qvcCvuVZFSnKwrE0QaVktqj5rq4XAmV51E9WcmajqIXHlTnzy2wFTWfbkpK7KmdmJ6capWSKpVlk5kcnEzspxLbkJ/+giN/w4aAKDxwSmnwXFhSNTWTAEBC2hTphIXkiinM0kCBulbI4ZViE7tBaodNmjEo6N2uqiO1QF5dmSEwTo+yWnbNHdsMu2D17/rRWParR1LJHu93i8qDUdzC08vRflke7xvYr65+aNcqYibQK0h5ESPMWTotf2z98XMktj9bH2Cl7IP0n7I5d0Q1k7a9zlufLx0jQB2TeP/dHZy2bzkylx/MTqbmJ+Cu6MYwR/KT3nsYcFrGEAvU9wiWucWP8MGaNBWOxlWq0xZxBvDEj/wLT9ZzH</latexit> Upsampling: ⇥ 8, channels: 256 <latexit sha1_base64="KJ7XXn/zBunvgXFFtc5qwHlyOl8=">AAACl3ichVFPSxtBFP+5/aOmtcb2YullaVA8lDAbg4ZcFATJMTGNCkbC7nYSh+zOLjuToC75Av0CCp5akFL6Hbx4qF+gh3yE0qOFXnroy2ahtKK+YWbe/N77vfebGSf0hNKMDSeMBw8fPZ6cms48eTrzbDY793xbBb3I5Q038IJo17EV94TkDS20x3fDiNu+4/Edp7sxiu/0eaREIN/qo5Dv+3ZHirZwbU1QK1toan6o40aobJ/6yU7ZHDS18LkyS2/McdB0D2wpuafKplUoDVrZHMuzxMybjpU6OaRWDbKf0MQ7BHDRgw8OCU2+BxuKxh4sMISE7SMmLCJPJHGOATLE7VEWpwyb0C6tHTrtpaik86imStgudfFoRsQ0scC+sc/sml2xL+w7+31rrTipMdJyRLsz5vKwNft+vv7rXpZPu8bBX9admjXaKCVaBWkPE2R0C3fM7x+fXNfLWwvxIvvIfpD+D2zILukGsv/TPa/xrTNk6AOs/5/7prNdyFsr+eVaMbdeTL9iCq/wGkv03qtYRwVVNKjvKS7wFVfGS2PN2DQq41RjIuW8wD9m1P4Az+6cxQ==</latexit> Upsampling: ⇥ 8, channels: 128 <latexit sha1_base64="2ubV1qqnZXRUSZXlGfdk7joEZEY=">AAACgHichVE9TxtBEH1cIIAhwYEGieYUy4gmzpxjAXZlyU1KG8eABMi6u6zJivXd6T6sEMsFLX+AggokhCIa8hvS8AdS8BMiSpBoUmTufAhRkMxqd2ffzJt9O2t5SgYh0fWI9mJ07OX4xGRmavrV65nsm9n1wI18W7RsV7n+pmUGQklHtEIZKrHp+cLsWkpsWHu1OL7RE34gXedTuO+Jna6568iOtM2QoXZ2ob9tdfRmZL3z5Feh9Jrr9FwVxcFBO5ujQpnKJSKdCpQYOyUqrhQN3UiRHFKru9lzbOMzXNiI0IWAg5B9BRMBjy0YIHiM7aDPmM+eTOICA2SYG3GW4AyT0T1ed/m0laIOn+OaQcK2+RbF02emjjz9ou90S1d0Qb/pz7O1+kmNWMs+79aQK7z2zOF88/6/rC7vIb48sv6pOUQHq4lWydq9BIlfYQ/5vW9Ht83KWr6/SKd0w/pP6Jp+8guc3p191hBrx8jwBzx0WX/eWS8WjOXCh0YxVy2lXzGBBbzFEvd7BVV8RB0tvvcA57jED03TlrT3mjFM1UZSzhyemFb5C+pXlEk=</latexit> Sub-pixel Convolution <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="ebYl+k5+WRNgMwpH0Pwimsu3rd4=">AAACbXichVHLSgMxFD0d3/XRqgiCIsVSdSElVVHpquDGZatWi1VkZkxr6DQzzEwLWvwB14ILUVAQET/DjT/gwk8QFy4U3LjwdjogWtQbkpyc3HNzkmiWIRyXsceA0tLa1t7R2RXs7untC4X7B9Yds2LrPKubhmnnNNXhhpA86wrX4DnL5mpZM/iGVlqq729Uue0IU665+xbfLqtFKQpCV12iNkvcltxIRhamd8JRFmdeRJpBwgdR+JE2w9fYwi5M6KigDA4Jl7ABFQ61PBJgsIjbRo04m5Dw9jkOESRthbI4ZajElmgs0irvs5LW9ZqOp9bpFIO6TcoIYuyB3bBXds9u2RP7+LVWzatR97JPs9bQcmsndDS8+v6vqkyzi70v1Z+eXRSw6HkV5N3ymPot9Ia+enDyuppcidUm2CV7Jv8X7JHd0Q1k9U2/yvCVUwTpAxI/n7sZrM/EE/Px2cxMNDXnf0UnRjCOKXrvBaSwjDSydK7EMc5wHnhRhpRRZayRqgR8zSC+hTL5CeKOjRA=</latexit> kernel: 7, <latexit sha1_base64="tje9uKLk9X1ITjVGGRju/tx+xWY=">AAACbnichVFNS8NAEH2NX7V+tCqIIGKwKJ7KtBa/TgUvHttqbaGKJHG1oWkSkrSgxT/gXTwIioKI+DO8+Ac8+BPEi6DgxYPTNCIe1Fl2d/btvNm3M6pt6K5H9BiSOjq7unvCvZG+/oHBaGxoeMO16o4mCpplWE5JVVxh6KYoeLpniJLtCKWmGqKoVlda98WGcFzdMte9fVts1ZQ9U9/VNcVjqKxVFNMUhrssp7djcUos0VKaSKYE+cZOmlILqaScDJA4AstasWtsYgcWNNRRg4AJj30DClweZSRBsBnbQpMxhz3dvxc4RIS5dY4SHKEwWuV1j0/lADX53Mrp+myNXzF4OsyUMU0PdEOvdE+39EQfv+Zq+jlaWvZ5V9tcYW9Hj8bW3v9l1Xj3UPlm/anZwy4Wfa06a7d9pPULrc1vHJy8ri3np5szdEnPrP+CHumOf2A23rSrnMifIsIN+Kqy/LuzkUok5xNzuVQ8kw5aEcY4pjDL9V5ABqvIouBX7BhnOA+9SKPShDTZDpVCAWcEP0ya/QSOJY3c</latexit> channels: 4 <latexit sha1_base64="j3ICVDtpWN1T1qjHV9/vB2DDNDw=">AAACbHichVG7SgNBFD1Z3/GR+CiEIARDxCpMVFSsBEFsBJOYhyQiu+skLtkXu5tADPkBWwsLtVAQET/Dxh+wyCeIYBPBxsKbzYJoUO8wM2fO3HPnzIxkqortMNb0CT29ff0Dg0P+4ZHRsUBwfCJjGxVL5mnZUA0rJ4k2VxWdpx3FUXnOtLioSSrPSuWN9n62yi1bMfRdp2byfU0s6UpRkUWHqL16QSqGt5ObjYNghMWYG+FuEPdABF7sGMFbFHAIAzIq0MChwyGsQoRNLY84GEzi9lEnziKkuPscDfhJW6EsThkisWUaS7TKe6xO63ZN21XLdIpK3SJlGFH2xO5Yiz2ye/bMPn6tVXdrtL3UaJY6Wm4eBE6mU+//qjSaHRx9qf707KCIVderQt5Nl2nfQu7oq8dnrdRaMlqfY9fshfxfsSZ7oBvo1Tf5JsGT5/DTB8R/Pnc3yCzE4suxxcRCZH3J+4pBhDCLeXrvFaxjCztI07kaTnGBS9+rMCWEhJlOquDzNJP4FsLcJ36qjOk=</latexit> MRF <latexit sha1_base64="j3ICVDtpWN1T1qjHV9/vB2DDNDw=">AAACbHichVG7SgNBFD1Z3/GR+CiEIARDxCpMVFSsBEFsBJOYhyQiu+skLtkXu5tADPkBWwsLtVAQET/Dxh+wyCeIYBPBxsKbzYJoUO8wM2fO3HPnzIxkqortMNb0CT29ff0Dg0P+4ZHRsUBwfCJjGxVL5mnZUA0rJ4k2VxWdpx3FUXnOtLioSSrPSuWN9n62yi1bMfRdp2byfU0s6UpRkUWHqL16QSqGt5ObjYNghMWYG+FuEPdABF7sGMFbFHAIAzIq0MChwyGsQoRNLY84GEzi9lEnziKkuPscDfhJW6EsThkisWUaS7TKe6xO63ZN21XLdIpK3SJlGFH2xO5Yiz2ye/bMPn6tVXdrtL3UaJY6Wm4eBE6mU+//qjSaHRx9qf707KCIVderQt5Nl2nfQu7oq8dnrdRaMlqfY9fshfxfsSZ7oBvo1Tf5JsGT5/DTB8R/Pnc3yCzE4suxxcRCZH3J+4pBhDCLeXrvFaxjCztI07kaTnGBS9+rMCWEhJlOquDzNJP4FsLcJ36qjOk=</latexit> MRF <latexit sha1_base64="/dV5MgkluHnru+XweyIbtPS1sWI=">AAACenichVHNSsNAEP4a/+tfVQTBS7AoilCntbTqSdCDR/+qgkpJ4rYupklI0ooGX8AX8OBJQUR9DC++gAcfQTwqePHgNI2IB3WW3Zn9dr6Zb3d1x5SeT/QUU5qaW1rb2jvinV3dPb2Jvv4Nz666higYtmm7W7rmCVNaouBL3xRbjiu0im6KTf1goX6+WROuJ21r3T9yxG5FK1uyJA3NZ6iYGAx29JK6YFu19OKJejhlq7rUvGIiSanZXJ6m8yqlKDQOsplcNjerpiMkiciW7cQ1drAHGwaqqEDAgs+xCQ0ej22kQXAY20XAmMuRDM8FThBnbpWzBGdojB7wWubddoRavK/X9EK2wV1Mni4zVYzSI93QKz3QHT3Tx6+1grBGXcsRe73BFU6x93Ro7f1fVoW9j/1v1p+afZQwE2qVrN0JkfotjAa/dnz2uja3OhqM0SW9sP4LeqJ7voFVezOuVsTqOeL8AV+vrP4ebGRS6VxqeiWTnM9GX9GOYYxgnN87j3ksYRkF7hvgAre4i30oI8qEMtlIVWIRZwA/TMl+ArIDkes=</latexit> Conv1D w/o bias <latexit sha1_base64="z3mrFr7lUs4Scrf6174xqeOU9YY=">AAACh3ichVE9bxNBEH05PpI4QAw0SDSnWEE0mLFj5YMqUVxQ5gPHkUJk7V3GySp3t6e79UnBokf8AYpUREIIIaUNPQ1/gCI/AVEmUpoUjM+HEEVgVrsz+3bezNtdLw50aolOR5xr12/cHB0bL03cun1nsnz33kZqeonPLd8EJtn0VMqBjrhltQ14M05YhV7AbW9/eXDezjhJtYle2IOYt0O1G+mu9pUVqFOearhNZdWTZqIzjtwm+yaMTco7bltl3DVJmHbKFaou0EKDyKUq5SZBg+pz9ZpbK5AKClsx5Y94iR0Y+OghBCOClTiAQipjCzUQYsG20RcskUjn54zXKAm3J1ksGUrQfVl3ZbdVoJHsBzXTnO1Ll0BmIkwX0/SdPtEZfaPP9IMur6zVz2sMtByI94ZcjjuTbx+sX/yXFYq32PvD+qdmiy7mc61atMc5MriFP+Rnr96drT9bm+4/oiP6Kfrf0yl9lRtE2bn/YZXXDlGSD/j9yu7VwUa9WputzqzWK4uN4ivG8BBTeCzvPYdFPMcKWtL3DY5xgi/OuPPUmXXmh6nOSMG5j7/MWfoFBaqWeg==</latexit> 4 Data-Driven Decomposed Waveforms
  3. Non autoregressive real-time neural vocoders Simultaneously synthesizing all speech waveform

    samples at once Category Flow-based models: Parallel WaveNet, WaveGlow, WaveFlow … Generative adversarial network (GAN)-based models: Parallel WaveGAN, (Multi-band) MelGAN, GAN-TTS … Diffusion probabilistic models: WaveGrad, DiffWave and DiffWaveGrad Problem Most of them require a GPU for real-time inference Real-time neural vocoders on CPUs HiFi-GAN and Multi-band MelGAN Upsampling-based generator with fewer number of layers HiFi-GAN with sophisticated generator and two discriminators can realize high- fi delity synthesis Introduction 3
  4. Property GAN-based real-time neural vocoder on CPUs Upsample-based high-speed generator

    Multi-period discriminator Modeling periodic patterns Multi-scale discriminator Capturing consecutive patterns and long-term dependencies Problem Tradeoff between synthesis quality and inference speed on CPUs HiFi-GAN V1 (large model): High-quality but slow inference speed HiFi-GAN V2 (small model): Fast inference speed but lower quality Purpose Improving inference speed of HiFi-GAN V1 while keeping synthesis quality HiFi-GAN neural vocoder 4 <latexit sha1_base64="5bv/Fn8RI0HR6kR253f7wpLXIZY=">AAACdHichVHLSsNAFD2N7/po1I2gi2KouLFMq6i4Ety4EeqjWqhSkjjW0MmDZFrQ4g/4Ay5cKRYRP8ONP+DCTxCXFd248DYNiIp6w2TOnLnnzpm5hiesQDL2GFM6Oru6e3r74v0Dg0MJdXhkO3Crvsnzpitcv2DoAReWw/PSkoIXPJ/rtiH4jlFZae3v1LgfWK6zJY88vmfrZcc6sExdElVSE2tczAQeN6Xvln3dLqkaS7Mwkj9BJgIaosi56jV2sQ8XJqqwweFAEhbQEdBXRAYMHnF7qBPnE7LCfY4TxElbpSxOGTqxFfqXaVWMWIfWrZpBqDbpFEHDJ2USKfbAbliT3bNb9sTef61VD2u0vBzRbLS13CslTsc23/5V2TRLHH6q/vQscYDF0KtF3r2Qad3CbOtrx2fNzaWNVH2KXbJn8n/BHtkd3cCpvZiNdb5xjjg1IPP9uX+C7Ww6M5+eXc9qy3NRK3oxjklM03svYBmryCEf9uQcV2jEXpUJRVNS7VQlFmlG8SWU9AejXJAn</latexit> Mel-spectrogram <latexit sha1_base64="TjNZeuUZP+A4auY4I4VNF/agWuE=">AAACh3ichVFBLyRBGH2aXYzdNbhIXDomZC87W4MgTkQiLhKGQYJMuts3VNR0d7qrJ2HiLv6Ag5NNNiISV+572T/g4CeII4mLg697OhEr7FepqlevvvfVqyrbVzLUQtw0Gc0tnz63trVnOr58/daZ7epeDr0ocKjkeMoLVm0rJCVdKmmpFa36AVlVW9GKvTMd76/UKAil5y7pXZ82qtaWKyvSsTRT5Wx/fd2umHOR0vJHkRzytayROSNJbZozUSzbL2dzIi+SMN+CQgpySGPey55iHZvw4CBCFQQXmrGChZDbGgoQ8JnbQJ25gJFM9gn7yLA24iziDIvZHR63eLWWsi6v45phonb4FMU9YKWJAXEtzsS9+CvOxa14erdWPakRe9nl2W5oyS93HvYuPv5XVeVZY/tF9aFnjQrGE6+SvfsJE9/Caehre0f3ixPFgfqg+CXu2P+JuBF/+AZu7cH5vUDFY2T4Awr/PvdbsDyUL4zmhxeGcpMj6Ve0oQ/9+M7vPYZJzGIeJT73ABe4xJXRbvw0Ro3xRqrRlGp68CqMqWdx3Zan</latexit> Multi-Receptive Field Fusion <latexit sha1_base64="aTJeJYllPzr7aMk5qOxFXeGTj2k=">AAACbnichVHLSsNAFD2Nr1ofrQoiiFgslbop0yoqrgqCuBH6sFqoRZI4raFpEpK0UEt/wL24EBQFEfEz3PgDLvoJ4kZQcOPC2zQgWtQbJnPmzD13ztyRDFWxbMZaHqGnt69/wDvoGxoeGfUHxsZ3LL1qyjwr66pu5iTR4qqi8ayt2CrPGSYXK5LKd6Xyent/t8ZNS9G1bbtu8EJFLGlKUZFFm6h8pLEnFYNb6Y3mwn4gxKLMiWA3iLkgBDeSeuAGeziADhlVVMChwSasQoRFXx4xMBjEFdAgziSkOPscTfhIW6UsThkisWX6l2iVd1mN1u2alqOW6RSVhknKIMLskd2yV/bA7tgT+/i1VsOp0fZSp1nqaLmx7z+eyrz/q6rQbOPwS/WnZxtFrDpeFfJuOEz7FnJHXzs6fc2spcONeXbFnsn/JWuxe7qBVnuTr1M8fQYfPUDsZ7u7wU48GluOLqbiocSS+xReTGMOEer3ChLYRBJZp2MnOMeF50WYFGaE2U6q4HE1E/gWQuQTcEyNTg==</latexit> (MRF) <latexit sha1_base64="aaxulfY/Me1bC7xaswKQDQUyBg4=">AAACg3ichVFNSxtRFD1OTY3R1lQ3QkEGQ0qhEO5Mg1EhILjp0o/GCImEmfHFDpkvZl5C7SQ7V/4BF64slNJ2qf+gm/6BLvwJ4lLBjQtvxpHShe19vHfvO++ee897zwwcO5JE5yPKk9HM07HseG5i8tnzqfyL6a3I74aWqFm+44fbphEJx/ZETdrSEdtBKAzXdETd7KwOz+s9EUa2772X+4HYcY09z27bliEZauXnmlJ8lHHbD9WB6lQ1tWnt+jJS+51W3B30W/kClZZoqUykUokS46BMekXXVC1FCkhtzc9/RRO78GGhCxcCHiTHDgxEPBrQQAgY20HMWMiRnZwLDJBjbpezBGcYjHZ43eNdI0U93g9rRgnb4i4Oz5CZKor0m77RFf2iH3RBt4/WipMaQy377M17rghaU4ezmzf/ZbnsJT78Yf1Ts0Qbi4lWm7UHCTK8hXXP7306utpc3ijGr+gzXbL+Ezqnn3wDr3dtfVkXG8fI8Qc8vLL6eLCll7SF0tv1cmGlnH5FFi8xj9f83hWs4B3WUOO+B/iOU5wpGeWNoitprjKScmbwlynVO1cclVY=</latexit> for l = 1 · · · |ku | <latexit sha1_base64="k8bMMz392/OeCXGAjAEN/0B0y5A=">AAACdXichVG7SgNBFD1ZXzG+Vm0EEYJRsYqzKipWARsLC40mChrC7jqJS/bF7iQQQ37AH7DQRiGK+Bk2/oCFnyCWCmksvNksiAb1DjNz5sw9d87MaK5p+IKx54jU1d3T2xftjw0MDg2PyKNjWd8pezrP6I7peAea6nPTsHlGGMLkB67HVUsz+b5W2mjt71e45xuOvSeqLs9ZatE2CoauCqLyslw70grxLa6WqvE038rU83KCJVkQ8U6ghCCBMLYd+RZHOIYDHWVY4LAhCJtQ4VM7hAIGl7gcasR5hIxgn6OOGGnLlMUpQyW2RGORVocha9O6VdMP1DqdYlL3SBnHLHtid+yNPbJ79sI+fq1VC2q0vFRp1tpa7uZHziZ2m/+qLJoFTr5Uf3oWKGAt8GqQdzdgWrfQ2/rK6fnb7np6tjbHrtkr+b9iz+yBbmBX3vXGDk9fIEYfoPx87k6QXUwqK8mlneVEajn8iigmMY15eu9VpLCJbWTo3Aou0cBNpClNSTPSXDtVioSacXwLaeETPIGP6w==</latexit> LeakyReLU <latexit sha1_base64="4W8kVIAFDYKqxJRx+bHFCFn2NAg=">AAACdnichVHLSsNAFD2N7/po1Y0gSLFUXZVbLSquBDcutVoVrJQkTjWYJiGZ1kfoD/gDLsSFghbxM9z4Ay78BHGpoAsX3qYBUVHvMDNnztxz58yM5piGJ4keIkpLa1t7R2dXtLunty8W7x9Y8+yKq4u8bpu2u6GpnjANS+SlIU2x4bhCLWumWNf2Fhr761XheoZtrcpDR2yV1R3LKBm6KpkqxvsLUhxI3y9opYRUrd1arRhPUpqCSPwEmRAkEcaSHa+jgG3Y0FFBGQIWJGMTKjxum8iA4DC3BZ85l5ER7AvUEGVthbMEZ6jM7vG4w6vNkLV43ajpBWqdTzG5u6xMIEX3dE3PdEc39Ejvv9bygxoNL4c8a02tcIqx46GV139VZZ4ldj9Vf3qWKGE28GqwdydgGrfQm/rq0cnzylwu5Y/RBT2x/3N6oFu+gVV90S+XRe4UUf6AzPfn/gnWJtOZ6fTUcjY5nw2/ohPDGMUEv/cM5rGIJeT53H2c4Qr1yJsyoqSU8WaqEgk1g/gSCn0AG36RSw==</latexit> tanh <latexit sha1_base64="72jwFmBf7ArVjZfy0drc6l3XlQk=">AAACenichVHLSsNAFD2N7/qKiiC4CS2KopSJFpWuBDcu1dpWUClJnGpoXiRpoQZ/wB9w4UpBRP0MN/6Ai36CuKzgpgtv0oCoqHeYmTNn7rlzZkZ1DN3zGWsmhK7unt6+/oHk4NDwyKg4Nl707Jqr8YJmG7a7pyoeN3SLF3zdN/ie43LFVA1eUqsb4X6pzl1Pt61dv+HwQ1M5tvSKrik+UWVxsspdixs5aXVR0k4UK8JyWUyzDItC+gnkGKQRx5Yt3uIAR7ChoQYTHBZ8wgYUeNT2IYPBIe4QAXEuIT3a5zhDkrQ1yuKUoRBbpfGYVvsxa9E6rOlFao1OMai7pJQww57ZHWuxJ/bAXlj711pBVCP00qBZ7Wi5Ux49n8q//6syafZx8qn607OPCtYirzp5dyImvIXW0ddPL1r53M5MMMuu2Sv5v2JN9kg3sOpv2s0237lEkj5A/v7cP0FxKSOvZJa3l9Lr2fgr+jGNFObovVexjk1soUDnBrjCPR4SbSElzAsLnVQhEWsm8CWE7AdFXZEz</latexit> kernel: 7, channel: 1 <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="rmaGGWigQ2Iz6dP42ogkDoIaY20=">AAACfXichVG7SgNBFD1ZXzE+ErUJ2ARDxELCREXFSrCxkiSaKGgIu+skLtkXu5NIDPoB/oCFlaKIiP6EjT9g4SeIZQQbQW82C6JBvcvOnDlzz71nZhRb11zB2FNA6uru6e0L9ocGBoeGw5GR0bxrVR2V51RLt5wtRXa5rpk8JzSh8y3b4bKh6HxTqay09jdr3HE1y9wQdZsXDLlsaiVNlQVRxUi0saOUYjnblQ1qZ5Zja1zsW07lsBiJsyTzItYJUj6Iw4+0FbnCDnZhQUUVBjhMCMI6ZLj0bSMFBpu4AhrEOYQ0b5/jECHSVimLU4ZMbIXGMq22fdakdaum66lV6qLT75AyhgR7ZNesyR7YDXtm77/Wang1Wl7qNCttLbeL4ePo+tu/KoNmgb0v1Z+eBUpY9Lxq5N32mNYp1La+dnDSXF/KJhqT7Jy9kP8z9sTu6QRm7VW9zPDsKUL0AKmf190J8jPJ1HxyNjMTX57znyKIcUxgiu57ActYRRo56nuEC9ziLvAhJaRpKdlOlQK+ZgzfQlr4BB/Vk/U=</latexit> Upsampling Network <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="0h5Q6c+6tKMEr+be7Oeuc5Rm3C4=">AAAChXichVG7SgNBFD2urxhfURvBZjFELDRMNBixUbCx9JUHJCHsrqNZstlddidBXdJa+AMWVgoioq3+gI0/YOEniKWCjYU3mwXRoN5hZs6cuefOmRnVNnRXMPbUIXV2dff0hvrC/QODQ8ORkdGMa9Ucjac1y7CcnKq43NBNnha6MHjOdrhSVQ2eVSurzf1snTuubpnb4sDmxaqyZ+q7uqYIokoRuSD4vvAq3DG5sSSnZmStrJg+bpRLXq1RikRZnPkht4NEAKIIYt2KXKKAHVjQUEMVHCYEYQMKXGp5JMBgE1eER5xDSPf3ORoIk7ZGWZwyFGIrNO7RKh+wJq2bNV1frdEpBnWHlDJi7JFdsVf2wK7ZM/v4tZbn12h6OaBZbWm5XRo+Ht96/1dVpVmg/KX607PALhZ9rzp5t32meQutpa8fnrxuLW3GvCl2zl7I/xl7Yvd0A7P+pl1s8M1ThOkDEj+fux1k5uKJhfj8RjK6kgy+IoQJTGKa3juFFaxhHWk69wg3uMWd1CvNSklpoZUqdQSaMXwLafkTZ+mVwA==</latexit> kernel: 7, channel: hu <latexit sha1_base64="CDfnGanWxP3iN5b9GeONSPbQgjA=">AAACeXichVHLSgMxFD0d3/VVHwvBTbVUiouSqqi4Ety4rNY+QKXMTFMNzouZtNAWf8AfcOFGBZHqZ7jxB1z4CeJSwYUuvJ0OiBb1hiQnJ/fcnCSaYwhPMvYYUrq6e3r7+gfCg0PDI6ORsfGcZ1dcnWd127DdgqZ63BAWz0ohDV5wXK6amsHz2tFGaz9f5a4nbGtH1hy+b6oHligLXZVEFSOTmZolD7kn6rwUzatVXrZdsxiJsSTzI9oJUgGIIYi0HbnGHkqwoaMCExwWJGEDKjxqu0iBwSFuHw3iXELC3+c4Rpi0FcrilKESe0TjAa12A9aidaum56t1OsWg7pIyijh7YE32wu7ZLXtiH7/Wavg1Wl5qNGttLXeKoydTmbd/VSbNEodfqj89S5Sx6nsV5N3xmdYt9La+Wj99yaxtxxtz7JI9k/8L9sju6AZW9VW/2uLbZwjTB6R+PncnyC0kU8vJxa2F2PpS8BX9mMYsEvTeK1jHJtLI0rl1nKOJm9C7MqMklPl2qhIKNBP4FsriJ6JSkmg=</latexit> Synthesized Waveform <latexit sha1_base64="ST6UIFFKrKC9MOwhAUT8GSWEZkU=">AAACg3ichVFdK0RBGH4c3+trcaOUTjYi2WaXkFKkcCVfi0LbOcdg2rPnnObMrtjcufIHXLiiJFzyD9z4Ay78BLmk3Ljw7tlTQninmXnmmfd555kZ07OFrxh7LNPKKyqrqmtqI3X1DY1N0eaWZd/NSYunLNd25app+NwWDk8poWy+6kluZE2br5iZyeL+Sp5LX7jOktrz+EbW2HbElrAMRVQ62tEz0avPiCnRPz0xq09zh0tDuVKf5WrXlZl0NMbiLAj9J0iEIIYw5tzoBdaxCRcWcsiCw4EibMOAT20NCTB4xG2gQJwkJIJ9jgNESJujLE4ZBrEZGrdptRayDq2LNf1AbdEpNnVJSh1d7IFdshd2z67ZE3v/tVYhqFH0skezWdJyL9101Lb49q8qS7PCzqfqT88KWxgJvAry7gVM8RZWSZ/fP35ZHF3oKnSzM/ZM/k/ZI7ujGzj5V+t8ni+cIEIfkPj+3D/BcjKeGIoPzCdj46PhV9SgHZ3oofcexjhmMIcUnXuIK9zgVqvU+rSkNlhK1cpCTSu+hDb2AfFNk7g=</latexit> (A) HiFi-GAN Generator Network
  5. Single network directly synthesizing speech waveforms from texts Duration model,

    acoustic model and neural vocoder are jointly trained as single network without acoustic features EATS: including GAN-TTS FastSpeech 2+: including Parallel WaveGAN Wave-Tacotron: including WaveGlow VITS: including HiFi-GAN (Open-source of fi cial implementation and ESPnet2-TTS) Reinforced-Aligner: including HiFi-GAN Demo sample : Full-band VITS trained using NICT’s English corpus and ESPnet2-TTS Entire end-to-end text-to-speech models 5 Hidden features Glow-TTS HiFi-GAN decoder Text (Phoneme sequence) Speech waveform Duration and acoustic model Neural vocoder Entire end-to-end text-to-speech model, VITS
  6. Three types of upsampling layers (a): Transposed convolution (b): Interpolation

    + convolution (c): Sub-pixel convolution (pixel-suf fl er) Investigation of upsampling layers in HiFi-GAN 6 <latexit sha1_base64="idMljum+Kx6PXHCXfGUp2syw1g8=">AAACyXichVFLaxRBEK5MfMT1kTW5CLkMbiKelp4YVHIK5CLkktcmgZ1l6ZntTZrtxzjdu24y9Cm3/AEPOSmEEPwZXsS7h/wE8SJEEMWDNbMDokGtpru/+qq+6uruKBHcWELOx7zxK1evXZ+4Ubl56/adyerdqS2j+2nMGrEWOt2JqGGCK9aw3Aq2k6SMykiw7ai3nMe3Byw1XKtNu5+wlqS7ind5TC1S7WonVOxFrKWkqpOFEXfNoJWFMtJD9LToSGr3/NlaMOtcJY/7vXbWd03Rcj66XT+0XDLjBw4RG9psxC5rNdhMqTKJNsy5drVG6qQw/zIISlCD0lZ19RRC6ICGGPoggYECi1gABYOjCQEQSJBrQYZciogXcQYOKqjtYxbDDIpsD9dd9Jolq9DPa5pCHeMpAmeKSh/myAdyRi7IO/KGfCQ//lorK2rkvezjHo20LGlPHt3b+PpflcTdwt4v1T97ttCFp0WvHHtPCia/RTzSDw5eXmwsrs9lD8hr8gn7f0XOyVu8gRp8iU/W2PoxVPADgj+f+zLYmq8Hj+uP1hZqSwvlV0zADNyHh/jeT2AJnsEqNPDc9/AZvsF3b8V77g29g1GqN1ZqpuE38w5/Aq/csjU=</latexit> ku[l]⇥1 ConvTranspose <latexit sha1_base64="yYh49sqxFuauLGquFlosAz/hXSw=">AAACn3ichVFBTxNBGH2sIKWCVLmQeFltajyYdlobID2RcNATKWAB09Zmdzu0k053N7vThrLpH+APePCiJoQQfoaJ8QYXD/wEwhESLh78drsJQYJ+m5158973vvlmxnSl8BVjZ2Pag/GJh5OJqeSj6ZnHs6knTzd9p+dZvGI50vG2TcPnUti8ooSSfNv1uNE1Jd8yOyuhvtXnni8c+70auLzeNVq22BGWoYhqpEo1xXdV4CtPNHlJH+qdRtAbVmU9V3itjzTdahu2zaUfyu1QzhU+BnLYSKVZlkWh3wX5GKQRR9lJHaKGJhxY6KELDhuKsIQBn74q8mBwiasjIM4jJCKdY4gkeXuUxSnDILZDY4tW1Zi1aR3W9CO3RbtI+j1y6siwX+yIXbKf7Jids9/31gqiGmEvA5rNkZe7jdn9+Y3r/7q6NCu0b1z/7FlhB0tRr4J6dyMmPIU18vf3Pl1ulNYzwUv2jV1Q/1/ZGftOJ7D7V9bBGl//jCQ9QP7v674LNgvZ/EL2zVoxvVyMnyKBZ3iBV3Tfi1jGO5RRoX2/4AdOcKo9195qq1p5lKqNxZ453Artwx8wn6Bi</latexit> stride: ku[l]/2, channels: hu/2l <latexit sha1_base64="eno4lb9FwEFWTn6Uu+Ij/Y8uEvc=">AAACbHichVG7SgNBFD1ZXzE+Eh+FIIIYDLEJswoqqQJaWCbG+EBFdtdJXNwXu5NADP6ArYWFWiiIiJ9h4w9Y5BNEsFGwsfDuZkFU1DvMzJkz99w5M6M6hu4JxpoRqa29o7Mr2h3r6e3rjycGBlc9u+pqvKTZhu2uq4rHDd3iJaELg687LldM1eBr6v6Cv79W466n29aKqDt821Qqll7WNUUQtZFe5GWlaoipnUSSZVgQ4z+BHIIkwsjbiWtsYRc2NFRhgsOCIGxAgUdtEzIYHOK20SDOJaQH+xyHiJG2SlmcMhRi92ms0GozZC1a+zW9QK3RKQZ1l5TjmGQP7Ia9sHt2yx7Z+6+1GkEN30udZrWl5c5O/Gik+PavyqRZYO9T9adngTLmA686eXcCxr+F1tLXDk5eitnlyUaKXbIn8n/BmuyObmDVXrWrAl8+RYw+QP7+3D/B6nRGns3MFKaTuWz4FVGMYgJpeu855LCEPEp0roljnOE88iwNS6PSWCtVioSaIXwJKfUBaSiM5A==</latexit> (Default) <latexit sha1_base64="5bv/Fn8RI0HR6kR253f7wpLXIZY=">AAACdHichVHLSsNAFD2N7/po1I2gi2KouLFMq6i4Ety4EeqjWqhSkjjW0MmDZFrQ4g/4Ay5cKRYRP8ONP+DCTxCXFd248DYNiIp6w2TOnLnnzpm5hiesQDL2GFM6Oru6e3r74v0Dg0MJdXhkO3Crvsnzpitcv2DoAReWw/PSkoIXPJ/rtiH4jlFZae3v1LgfWK6zJY88vmfrZcc6sExdElVSE2tczAQeN6Xvln3dLqkaS7Mwkj9BJgIaosi56jV2sQ8XJqqwweFAEhbQEdBXRAYMHnF7qBPnE7LCfY4TxElbpSxOGTqxFfqXaVWMWIfWrZpBqDbpFEHDJ2USKfbAbliT3bNb9sTef61VD2u0vBzRbLS13CslTsc23/5V2TRLHH6q/vQscYDF0KtF3r2Qad3CbOtrx2fNzaWNVH2KXbJn8n/BHtkd3cCpvZiNdb5xjjg1IPP9uX+C7Ww6M5+eXc9qy3NRK3oxjklM03svYBmryCEf9uQcV2jEXpUJRVNS7VQlFmlG8SWU9AejXJAn</latexit> Mel-spectrogram <latexit sha1_base64="TjNZeuUZP+A4auY4I4VNF/agWuE=">AAACh3ichVFBLyRBGH2aXYzdNbhIXDomZC87W4MgTkQiLhKGQYJMuts3VNR0d7qrJ2HiLv6Ag5NNNiISV+572T/g4CeII4mLg697OhEr7FepqlevvvfVqyrbVzLUQtw0Gc0tnz63trVnOr58/daZ7epeDr0ocKjkeMoLVm0rJCVdKmmpFa36AVlVW9GKvTMd76/UKAil5y7pXZ82qtaWKyvSsTRT5Wx/fd2umHOR0vJHkRzytayROSNJbZozUSzbL2dzIi+SMN+CQgpySGPey55iHZvw4CBCFQQXmrGChZDbGgoQ8JnbQJ25gJFM9gn7yLA24iziDIvZHR63eLWWsi6v45phonb4FMU9YKWJAXEtzsS9+CvOxa14erdWPakRe9nl2W5oyS93HvYuPv5XVeVZY/tF9aFnjQrGE6+SvfsJE9/Caehre0f3ixPFgfqg+CXu2P+JuBF/+AZu7cH5vUDFY2T4Awr/PvdbsDyUL4zmhxeGcpMj6Ve0oQ/9+M7vPYZJzGIeJT73ABe4xJXRbvw0Ro3xRqrRlGp68CqMqWdx3Zan</latexit> Multi-Receptive Field Fusion <latexit sha1_base64="aTJeJYllPzr7aMk5qOxFXeGTj2k=">AAACbnichVHLSsNAFD2Nr1ofrQoiiFgslbop0yoqrgqCuBH6sFqoRZI4raFpEpK0UEt/wL24EBQFEfEz3PgDLvoJ4kZQcOPC2zQgWtQbJnPmzD13ztyRDFWxbMZaHqGnt69/wDvoGxoeGfUHxsZ3LL1qyjwr66pu5iTR4qqi8ayt2CrPGSYXK5LKd6Xyent/t8ZNS9G1bbtu8EJFLGlKUZFFm6h8pLEnFYNb6Y3mwn4gxKLMiWA3iLkgBDeSeuAGeziADhlVVMChwSasQoRFXx4xMBjEFdAgziSkOPscTfhIW6UsThkisWX6l2iVd1mN1u2alqOW6RSVhknKIMLskd2yV/bA7tgT+/i1VsOp0fZSp1nqaLmx7z+eyrz/q6rQbOPwS/WnZxtFrDpeFfJuOEz7FnJHXzs6fc2spcONeXbFnsn/JWuxe7qBVnuTr1M8fQYfPUDsZ7u7wU48GluOLqbiocSS+xReTGMOEer3ChLYRBJZp2MnOMeF50WYFGaE2U6q4HE1E/gWQuQTcEyNTg==</latexit> (MRF) <latexit sha1_base64="aaxulfY/Me1bC7xaswKQDQUyBg4=">AAACg3ichVFNSxtRFD1OTY3R1lQ3QkEGQ0qhEO5Mg1EhILjp0o/GCImEmfHFDpkvZl5C7SQ7V/4BF64slNJ2qf+gm/6BLvwJ4lLBjQtvxpHShe19vHfvO++ee897zwwcO5JE5yPKk9HM07HseG5i8tnzqfyL6a3I74aWqFm+44fbphEJx/ZETdrSEdtBKAzXdETd7KwOz+s9EUa2772X+4HYcY09z27bliEZauXnmlJ8lHHbD9WB6lQ1tWnt+jJS+51W3B30W/kClZZoqUykUokS46BMekXXVC1FCkhtzc9/RRO78GGhCxcCHiTHDgxEPBrQQAgY20HMWMiRnZwLDJBjbpezBGcYjHZ43eNdI0U93g9rRgnb4i4Oz5CZKor0m77RFf2iH3RBt4/WipMaQy377M17rghaU4ezmzf/ZbnsJT78Yf1Ts0Qbi4lWm7UHCTK8hXXP7306utpc3ijGr+gzXbL+Ezqnn3wDr3dtfVkXG8fI8Qc8vLL6eLCll7SF0tv1cmGlnH5FFi8xj9f83hWs4B3WUOO+B/iOU5wpGeWNoitprjKScmbwlynVO1cclVY=</latexit> for l = 1 · · · |ku | <latexit sha1_base64="k8bMMz392/OeCXGAjAEN/0B0y5A=">AAACdXichVG7SgNBFD1ZXzG+Vm0EEYJRsYqzKipWARsLC40mChrC7jqJS/bF7iQQQ37AH7DQRiGK+Bk2/oCFnyCWCmksvNksiAb1DjNz5sw9d87MaK5p+IKx54jU1d3T2xftjw0MDg2PyKNjWd8pezrP6I7peAea6nPTsHlGGMLkB67HVUsz+b5W2mjt71e45xuOvSeqLs9ZatE2CoauCqLyslw70grxLa6WqvE038rU83KCJVkQ8U6ghCCBMLYd+RZHOIYDHWVY4LAhCJtQ4VM7hAIGl7gcasR5hIxgn6OOGGnLlMUpQyW2RGORVocha9O6VdMP1DqdYlL3SBnHLHtid+yNPbJ79sI+fq1VC2q0vFRp1tpa7uZHziZ2m/+qLJoFTr5Uf3oWKGAt8GqQdzdgWrfQ2/rK6fnb7np6tjbHrtkr+b9iz+yBbmBX3vXGDk9fIEYfoPx87k6QXUwqK8mlneVEajn8iigmMY15eu9VpLCJbWTo3Aou0cBNpClNSTPSXDtVioSacXwLaeETPIGP6w==</latexit> LeakyReLU <latexit sha1_base64="4W8kVIAFDYKqxJRx+bHFCFn2NAg=">AAACdnichVHLSsNAFD2N7/po1Y0gSLFUXZVbLSquBDcutVoVrJQkTjWYJiGZ1kfoD/gDLsSFghbxM9z4Ay78BHGpoAsX3qYBUVHvMDNnztxz58yM5piGJ4keIkpLa1t7R2dXtLunty8W7x9Y8+yKq4u8bpu2u6GpnjANS+SlIU2x4bhCLWumWNf2Fhr761XheoZtrcpDR2yV1R3LKBm6KpkqxvsLUhxI3y9opYRUrd1arRhPUpqCSPwEmRAkEcaSHa+jgG3Y0FFBGQIWJGMTKjxum8iA4DC3BZ85l5ER7AvUEGVthbMEZ6jM7vG4w6vNkLV43ajpBWqdTzG5u6xMIEX3dE3PdEc39Ejvv9bygxoNL4c8a02tcIqx46GV139VZZ4ldj9Vf3qWKGE28GqwdydgGrfQm/rq0cnzylwu5Y/RBT2x/3N6oFu+gVV90S+XRe4UUf6AzPfn/gnWJtOZ6fTUcjY5nw2/ohPDGMUEv/cM5rGIJeT53H2c4Qr1yJsyoqSU8WaqEgk1g/gSCn0AG36RSw==</latexit> tanh <latexit sha1_base64="72jwFmBf7ArVjZfy0drc6l3XlQk=">AAACenichVHLSsNAFD2N7/qKiiC4CS2KopSJFpWuBDcu1dpWUClJnGpoXiRpoQZ/wB9w4UpBRP0MN/6Ai36CuKzgpgtv0oCoqHeYmTNn7rlzZkZ1DN3zGWsmhK7unt6+/oHk4NDwyKg4Nl707Jqr8YJmG7a7pyoeN3SLF3zdN/ie43LFVA1eUqsb4X6pzl1Pt61dv+HwQ1M5tvSKrik+UWVxsspdixs5aXVR0k4UK8JyWUyzDItC+gnkGKQRx5Yt3uIAR7ChoQYTHBZ8wgYUeNT2IYPBIe4QAXEuIT3a5zhDkrQ1yuKUoRBbpfGYVvsxa9E6rOlFao1OMai7pJQww57ZHWuxJ/bAXlj711pBVCP00qBZ7Wi5Ux49n8q//6syafZx8qn607OPCtYirzp5dyImvIXW0ddPL1r53M5MMMuu2Sv5v2JN9kg3sOpv2s0237lEkj5A/v7cP0FxKSOvZJa3l9Lr2fgr+jGNFObovVexjk1soUDnBrjCPR4SbSElzAsLnVQhEWsm8CWE7AdFXZEz</latexit> kernel: 7, channel: 1 <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="rmaGGWigQ2Iz6dP42ogkDoIaY20=">AAACfXichVG7SgNBFD1ZXzE+ErUJ2ARDxELCREXFSrCxkiSaKGgIu+skLtkXu5NIDPoB/oCFlaKIiP6EjT9g4SeIZQQbQW82C6JBvcvOnDlzz71nZhRb11zB2FNA6uru6e0L9ocGBoeGw5GR0bxrVR2V51RLt5wtRXa5rpk8JzSh8y3b4bKh6HxTqay09jdr3HE1y9wQdZsXDLlsaiVNlQVRxUi0saOUYjnblQ1qZ5Zja1zsW07lsBiJsyTzItYJUj6Iw4+0FbnCDnZhQUUVBjhMCMI6ZLj0bSMFBpu4AhrEOYQ0b5/jECHSVimLU4ZMbIXGMq22fdakdaum66lV6qLT75AyhgR7ZNesyR7YDXtm77/Wang1Wl7qNCttLbeL4ePo+tu/KoNmgb0v1Z+eBUpY9Lxq5N32mNYp1La+dnDSXF/KJhqT7Jy9kP8z9sTu6QRm7VW9zPDsKUL0AKmf190J8jPJ1HxyNjMTX57znyKIcUxgiu57ActYRRo56nuEC9ziLvAhJaRpKdlOlQK+ZgzfQlr4BB/Vk/U=</latexit> Upsampling Network <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="0h5Q6c+6tKMEr+be7Oeuc5Rm3C4=">AAAChXichVG7SgNBFD2urxhfURvBZjFELDRMNBixUbCx9JUHJCHsrqNZstlddidBXdJa+AMWVgoioq3+gI0/YOEniKWCjYU3mwXRoN5hZs6cuefOmRnVNnRXMPbUIXV2dff0hvrC/QODQ8ORkdGMa9Ucjac1y7CcnKq43NBNnha6MHjOdrhSVQ2eVSurzf1snTuubpnb4sDmxaqyZ+q7uqYIokoRuSD4vvAq3DG5sSSnZmStrJg+bpRLXq1RikRZnPkht4NEAKIIYt2KXKKAHVjQUEMVHCYEYQMKXGp5JMBgE1eER5xDSPf3ORoIk7ZGWZwyFGIrNO7RKh+wJq2bNV1frdEpBnWHlDJi7JFdsVf2wK7ZM/v4tZbn12h6OaBZbWm5XRo+Ht96/1dVpVmg/KX607PALhZ9rzp5t32meQutpa8fnrxuLW3GvCl2zl7I/xl7Yvd0A7P+pl1s8M1ThOkDEj+fux1k5uKJhfj8RjK6kgy+IoQJTGKa3juFFaxhHWk69wg3uMWd1CvNSklpoZUqdQSaMXwLafkTZ+mVwA==</latexit> kernel: 7, channel: hu <latexit sha1_base64="CDfnGanWxP3iN5b9GeONSPbQgjA=">AAACeXichVHLSgMxFD0d3/VVHwvBTbVUiouSqqi4Ety4rNY+QKXMTFMNzouZtNAWf8AfcOFGBZHqZ7jxB1z4CeJSwYUuvJ0OiBb1hiQnJ/fcnCSaYwhPMvYYUrq6e3r7+gfCg0PDI6ORsfGcZ1dcnWd127DdgqZ63BAWz0ohDV5wXK6amsHz2tFGaz9f5a4nbGtH1hy+b6oHligLXZVEFSOTmZolD7kn6rwUzatVXrZdsxiJsSTzI9oJUgGIIYi0HbnGHkqwoaMCExwWJGEDKjxqu0iBwSFuHw3iXELC3+c4Rpi0FcrilKESe0TjAa12A9aidaum56t1OsWg7pIyijh7YE32wu7ZLXtiH7/Wavg1Wl5qNGttLXeKoydTmbd/VSbNEodfqj89S5Sx6nsV5N3xmdYt9La+Wj99yaxtxxtz7JI9k/8L9sju6AZW9VW/2uLbZwjTB6R+PncnyC0kU8vJxa2F2PpS8BX9mMYsEvTeK1jHJtLI0rl1nKOJm9C7MqMklPl2qhIKNBP4FsriJ6JSkmg=</latexit> Synthesized Waveform <latexit sha1_base64="ST6UIFFKrKC9MOwhAUT8GSWEZkU=">AAACg3ichVFdK0RBGH4c3+trcaOUTjYi2WaXkFKkcCVfi0LbOcdg2rPnnObMrtjcufIHXLiiJFzyD9z4Ay78BLmk3Ljw7tlTQninmXnmmfd555kZ07OFrxh7LNPKKyqrqmtqI3X1DY1N0eaWZd/NSYunLNd25app+NwWDk8poWy+6kluZE2br5iZyeL+Sp5LX7jOktrz+EbW2HbElrAMRVQ62tEz0avPiCnRPz0xq09zh0tDuVKf5WrXlZl0NMbiLAj9J0iEIIYw5tzoBdaxCRcWcsiCw4EibMOAT20NCTB4xG2gQJwkJIJ9jgNESJujLE4ZBrEZGrdptRayDq2LNf1AbdEpNnVJSh1d7IFdshd2z67ZE3v/tVYhqFH0skezWdJyL9101Lb49q8qS7PCzqfqT88KWxgJvAry7gVM8RZWSZ/fP35ZHF3oKnSzM/ZM/k/ZI7ujGzj5V+t8ni+cIEIfkPj+3D/BcjKeGIoPzCdj46PhV9SgHZ3oofcexjhmMIcUnXuIK9zgVqvU+rSkNlhK1cpCTSu+hDb2AfFNk7g=</latexit> (A) HiFi-GAN Generator Network <latexit sha1_base64="xCYrClKOgYAwONeUsDSGjhgmbs8=">AAACj3ichVE9SwNBEH2e3/Er0UawOQxKYhE2EVQsJKCFdokmGogS7s5NPLzcHneXgAb/gJWdhZWCiNjbKtj4ByzyE8RSwcbCucuBaFBn2d2ZN/Nm3+6qlqE7LmPNDqmzq7unt68/NDA4NDwSjoxuOqJmazyvCUPYBVVxuKGbPO/qrsELls2VqmrwLXV/2ctv1bnt6MLMuQcW36kqFVMv65riElQKz8SUuJyzFdOxhMN35WVh1oVR85JybIVrX2G8FI6yBPNNbneSgRNFYBkRvsI2diGgoYYqOEy45BtQ4NAoIgkGi7AdNAizydP9PMcRQsStURWnCoXQfVorFBUD1KTY6+n4bI1OMWjaxJQxxZ7YNXtlj+yGPbOPX3s1/B6elgPa1RaXW6WR4/GN939ZVdpd7H2x/tTsoowFX6tO2i0f8W6htfj1w9PXjcX1qcY0u2AvpP+cNdkD3cCsv2mXWb5+hhB9QPLnc7c7m6lEci4xm01F04vBV/RhApOI0XvPI41VZJCnc09wizvcSxFpXlqS0q1SqSPgjOGbSWufvw2Z2Q==</latexit> (a) Transposed Convolution (Deconvolution) <latexit sha1_base64="xt4tKytUqbgmsJulBs6FXC6OTCs=">AAACeHichVHLSgMxFD0d3/U12o3gZrD42pS0ioqrghvdVWtVUCkzY6qD82ImLdShP+APuHAhCqLFz3DjD7joJ4jLCoK48HY6ICrqDUlOTu65OUk01zR8wVgjJnV0dnX39PbF+wcGh4blkdEt3yl7Oi/ojul4O5rqc9OweUEYwuQ7rsdVSzP5tna80trfrnDPNxx7U1Rdvm+ph7ZRMnRVEFWUE8GeVlLWbME91zFDslaUkyzFwlB+gnQEkogi58g32MMBHOgowwKHDUHYhAqf2i7SYHCJ20dAnEfICPc5aoiTtkxZnDJUYo9pPKTVbsTatG7V9EO1TqeY1D1SKphkj6zOmuyB3bEn9v5rrSCs0fJSpVlra7lbHD4dy7/+q7JoFjj6VP3pWaCEpdCrQd7dkGndQm/rKydnzfzyxmQwxa7YM/m/ZA12TzewKy/69TrfOEecPiD9/bl/gq1MKr2QmlvPJLPz0Vf0YhwTmKH3XkQWq8ihQOdWcYFb1GNvkiJNS7PtVCkWaRL4ElLmA7f9kgE=</latexit> Interpolation <latexit sha1_base64="gaNH//ypL7rY31kJ/vk1cjWtvgA=">AAACe3ichVHLSgMxFD0d3/VVFURwUyyKipTUN64KblxJq1YFlTIzxjY4nQwzaaFWf8AfcOHKgojUv3DjD7jwE8SlghsFb6cDoqLekOTk5J6bk8RwLOEpxh5CWlNzS2tbe0e4s6u7pzfS17/pyaJr8owpLeluG7rHLWHzjBLK4tuOy/WCYfEt43C5vr9V4q4npL2hyg7fK+g5WxwIU1dEZSOD46tcd7mnojYXubwh3byU+xPZSIzFmR/RnyARgBiCSMnIFXaxDwkTRRTAYUMRtqDDo7aDBBgc4vZQIc4lJPx9jhOESVukLE4ZOrGHNOZotROwNq3rNT1fbdIpFnWXlFGMsnt2zZ7ZHauxR/b2a62KX6PupUyz0dByJ9t7OrT++q+qQLNC/lP1p2eFAyz6XgV5d3ymfguzoS8dnT2vL62NVsZYlT2R/wv2wG7pBnbpxbxM87VzhOkDEt+f+yfYnI4n5uMz6elYcjb4inYMYwTj9N4LSGIFKWTo3GNUUcNN6F2LaZPaVCNVCwWaAXwJbe4DacWStg==</latexit> (Nearest neighborhood) <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="QmTCWvvtKCecsFLuxPbtoCZfH8k=">AAACnXichVFNS+NAGH6Mq9b6VfWy4GGDRfGgdaKixZOwCB5k8atWqN2SxNGGTpOQTItu6B/wD+xBEBRExJ+xHrzozYM/QTy6sBcPvkkDsiu6b8jMM8/zPu+8M2O4wvIlY/ctSuuntvaORGeyq7unty/VP7DpOzXP5DnTEY63Zeg+F5bNc9KSgm+5HterhuB5o/I11PN17vmWY2/IA5cXq/qebe1api6JKqWy25Lvy6DCPZuLebVRKQW1RkEUJ7RxtSmpZlm3SfRJLYfq5NT3QDRKqTTLsCjUt0CLQRpxrDipc2xjBw5M1FAFhw1JWECHT18BGhhc4ooIiPMIWZHO0UCSvDXK4pShE1uhcY9WhZi1aR3W9CO3SbsI+j1yqhhhd+yCPbFrdske2PO7tYKoRtjLAc1G08vdUt/h5/U//3VVaZYov7o+7FliF9moV4t6dyMmPIXZ9Nd//Hxan18bCUbZKXuk/k/YPftFJ7Drv82zVb52hCQ9gPbvdb8Fm1MZbTYzvTqTXpiJnyKBIQxjjO57DgtYwgpytO8xrnCDW+WLsqgsK9+aqUpL7BnEX6HkXwAqwaAB</latexit> kernel: ku[l] 1, channels: hu/2l <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="KIHMEGZ232JL770CeTgUaEqXQiA=">AAACnnichVFNSxtBGH7cqk1Ta1Z7KfSyGBRBibMatHoSCsWL1ETzAUkMu9vRLJnsLruToF3yB/oHeuihVCil9GcUwZM99eBPKB4jePHgu5uFUqXtu+y8zzzzPu88M2N6wg4kYxcjyoPRsfGHqUfpxxNPJjPq1HQ5cLu+xUuWK1y/ahoBF7bDS9KWglc9nxsdU/CK2X4ZrVd63A9s19mTxx5vdIxDxz6wLUMS1VTX65IfybDNfYeLDa2/sqgNGc1qGQ5xAZHtZtjt10SjFeWl5f1QLOj9ppplORaHdh/oCcgiiR1X/YI63sCFhS464HAgCQsYCOirQQeDR1wDIXE+ITte5+gjTdouVXGqMIht03hIs1rCOjSPegax2qJdBP0+KTXMsp/sKxuwM/aN/WI3f+0Vxj0iL8eUzaGWe83Mu2e71/9VdShLtH6r/ulZ4gAvYq82efdiJjqFNdT33r4f7G4UZ8M5dsIuyf8ndsG+0wmc3pX1ucCLH5CmB9DvXvd9UF7O6au5lUI+u5lPniKF55jBPN33GjaxhR2UaN+POMU5fiia8krZVl4PS5WRRPMUf4RSvQXCC6A8</latexit> kernel: 3, channels: ku[l]hu/2l+1 <latexit sha1_base64="s6togqj51GCrZRakaqvdwn/NIRc=">AAACcHichVG7SgNBFD1Z3/EVtREsjIaIWIRZFRUrwcYyD5MIJoTddRIX9+XuJKDBH/AHUtioICJ+ho0/YJFPEDsj2Fh4s1kQDeodZubMmXvunJlRHUP3BGPNkNTT29c/MDgUHh4ZHRuPTEzmPLvqajyr2Ybt7qmKxw3d4lmhC4PvOS5XTNXgefVou72fr3HX021rV5w4vGgqFUsv65oiiCrWC2o5mubeoeLws1IkxhLMj2g3kAMQQxBJO3KLAg5gQ0MVJjgsCMIGFHjU9iGDwSGuiDpxLiHd3+c4Q5i0VcrilKEQe0RjhVb7AWvRul3T89UanWJQd0kZRZw9sTvWYo/snj2zj19r1f0abS8nNKsdLXdK4+fTmfd/VSbNAodfqj89C5Sx4XvVybvjM+1baB197bTRymym4/UFds1eyP8Va7IHuoFVe9NuUjx9gTB9gPzzubtBbjkhryVWUsuxrdXgKwYxg3ks0nuvYws7SCJL5x6jgUtchV6laWlWmuukSqFAM4VvIS19AurAjvQ=</latexit> Reshape <latexit sha1_base64="HqXFtNFOF8T9Meilumauuwc8cPc=">AAACpHichVHPTxNBFP5YUbH+oMDFxMvGBuLBlGkhQrhA4sUDB6AUSNrS7K6PdtLZ2c3utBE2/Qf4Bzx40oQYwp/hxYSrHPgTjEdIvHjw7XYTo0R9m5355nvf9+bNjBsqGRshLsesW+O379yduFe4/+Dho8ni1PROHPQjj+peoIJoz3ViUlJT3UijaC+MyPFdRbtu72Wa3x1QFMtAb5vDkFq+09HyQHqOYapdXG0aemOSddId012xh00jfYrtXjvpDxuqNV99bo8Uttd1tCYVs6ibZuer+4katoslURZZ2DdBJQcl5LERFD+iidcI4KEPHwQNw1jBQcxfAxUIhMy1kDAXMZJZnjBEgb19VhErHGZ7PHZ41chZzeu0Zpy5Pd5F8R+x08asuBCn4kp8Fmfiq/jx11pJViPt5ZBnd+SlsD15/Lj2/b8un2eD7i/XP3s2OMBy1qvk3sOMSU/hjfyDo7dXtZWt2WROfBDfuP/34lJ84hPowbV3sklb71DgB6j8ed03wU61XHlRXthcLK0t5k8xgSd4imd830tYwytsoM77nuAcX3BhzVnrVs2qj6TWWO6ZwW9h7f8Ez9qiyQ==</latexit> Length: ⇥ ku[l]/2, channels: hu/2l <latexit sha1_base64="hcCWSgzLMq1j4qZhybQbR/ttB/w=">AAAChHichVFNLwNBGH6s7/oqLhIHGw0hpJkSH3GQJr1wa1GaILK7Rm063dnsTpvQOLr4Aw5OJCLiyi9w8Qcc/ARxrMTFwdvtJoLgnczMM8+8zzvPzJiusH3F2FOD1tjU3NLa1h7p6Ozq7on29q37suRZPGtJIb2cafhc2A7PKlsJnnM9bhRNwTfMQqq2v1Hmnm9LZ00duHy7aOQde8+2DEXUTnRozBzXlx3FPVeKgNMn9JR0ylKU6hkxFmdB6D9BIgQxhJGW0StsYRcSFkoogsOBIixgwKe2iQQYXOK2USHOI2QH+xxHiJC2RFmcMgxiCzTmabUZsg6tazX9QG3RKYK6R0odI+yRXbMqe2A37Jm9/1qrEtSoeTmg2axrubvTczKw+vavqkizwv6n6k/PCnuYD7za5N0NmNotrLq+fHhaXV1YGamMsgv2Qv7P2RO7pxs45VfrMsNXzhChD0h8f+6fYH0qnpiNT2emYsmF8CvaMIhhjNF7zyGJJaSRpXOPcYNb3Gkt2qQ2rc3UU7WGUNOPL6EtfgD4TpUi</latexit> (b) Interpolation + Convolution <latexit sha1_base64="UPT40h4fQ7896+EYhSt5VTOaOHw=">AAACfnichVG7SgNBFD2urxhfURvFJhgMsUicRNCQKmBjmRijgorsrpM4ONld9hGMQez9AQsrBRER9CNs/AELP0EsFWwsvNksiIp6l505c+49d87MaJYUjsvYY4fS2dXd0xvqC/cPDA4NR0ZGVx3Ts3Ve1k1p2uua6nApDF52hSv5umVztaZJvqbtLbbya3VuO8I0VtyGxbdqatUQFaGrLlHbkYmEPhMteVrSEvtcRhdNo25Kr52LsRTzI/oTpAMQQxAFM3KJTezAhA4PNXAYcAlLqHDo20AaDBZxW2gSZxMSfp7jEGHSelTFqUIldo/GKq02Atagdaun46t12kXSb5Myimn2wK7YC7tn1+yJvf/aq+n3aHlp0Ky1tdzaHj4eL739q6rR7GL3U/WnZxcVZH2vgrxbPtM6hd7W1w9OXkq55elmnJ2zZ/J/xh7ZHZ3AqL/qF0W+fIowPUD6+3X/BKuZVHo+NVfMxPK54ClCmMQUEnTfC8hjCQWUad8jXOAGtwqUuJJUZtulSkegGcOXULIfZt6SrQ==</latexit> (c) Sub-pixel Convolution
  7. Multi-band MelGAN neural vocoder 7 Property Introducing multi-rate signal processing

    into MelGAN 
 (as our proposed subband WaveNet and FFTNet) Four subband waveforms are integrated by a synthesis fi lter bank Accelerating inference speed while keeping synthesis quality Problem Lower synthesis quality than HiFi-GAN V1 Investigation of Multi-band HiFi-GAN Cannot be trained well Multi-band constraint is too strong for HiFi-GAN Discriminators can easily distinguish between real and synthesized speech <latexit sha1_base64="zalZsOwrTJnssA7Or2DptbCUKH8=">AAACaXichVFNLwNBGH66vqq+ikvDpbEhTs0sgjhJXBz7TULT7K5Rw3Z3szttUo0/4OQmOJGIiJ/h4g84+AnSI4mLg7fbTQTBO5mZZ555n3eemTFcS/iSsaeI0tXd09sX7Y8NDA4Nj8RHx4q+U/NMXjAdy/E2Dd3nlrB5QQpp8U3X43rVsPiGcbDW3t+oc88Xjp2XDZeXqnrFFrvC1CVRxbzuVbgsx1WWYkEkfwItBCrCSDvxG2xjBw5M1FAFhw1J2IIOn9oWNDC4xJXQJM4jJIJ9jiPESFujLE4ZOrEHNFZotRWyNq3bNf1AbdIpFnWPlElMs0d2y17YA7tjz+z911rNoEbbS4Nmo6PlbnnkOJF7+1dVpVli71P1p2eJXSwHXgV5dwOmfQuzo68fnr7kVrLTzRl2xVrk/5I9sXu6gV1/Na8zPHuBGH2A9v25f4LiXEpbTM1n5tTVhfAropjEFGbpvZewinWkUaBz93GCM5xHWsqoklAmOqlKJNSM40so6geTAowR</latexit> Target <latexit sha1_base64="s5ApCbZZx5L/zNvoq+CKUJcKDQ0=">AAACa3ichVG7SgNBFD1ZXzE+Ek0jahEMEaswiaJiFbCxzMM8IIawu050yb7Y3QRi8AcsbSxioyAifoaNP2CRTxCximBj4c1mQTSod5mdM2fuuXPmjmSqiu0w1vUJI6Nj4xP+ycDU9MxsMDQ3X7CNhiXzvGyohlWSRJuris7zjuKovGRaXNQklRel+m5/v9jklq0Y+r7TMnlFE490pabIokNUqSg2ec2wtGooyuLMjcgwSHggCi/SRugWBziEARkNaODQ4RBWIcKmr4wEGEziKmgTZxFS3H2OUwRI26AsThkisXX6H9Gq7LE6rfs1bVct0ykqDYuUEcTYE7tjPfbI7tkz+/i1Vtut0ffSolkaaLlZDZ4t5N7/VWk0Ozj+Uv3p2UEN265XhbybLtO/hTzQN08uermdbKy9yq7ZC/m/Yl32QDfQm2/yTYZnOwjQAyR+tnsYFJLxxGZ8PZOMpja8p/BjCStYo35vIYU9pJF3+3yODi59r0JYWBSWB6mCz9OE8S2E2CejUI0F</latexit> Waveform <latexit sha1_base64="dWj55yBlxJbUcxQjr3b+lPnnHSE=">AAACf3ichVHLSiNBFD1pddTojFE3opvG4IyrcKPia+UDxKWvqKASunsqTpFKd9NdCcQguPYHXLhSUBEX+g9u/AEXfoK4VHDjwptOwzAjM96iqk6duufWqSrbVzLURA8Jo6m55UtrW3uyo/Prt65Ud8966JUDR+QcT3nBpm2FQklX5LTUSmz6gbBKthIbdnG+vr9REUEoPXdNV32xU7J2XVmQjqWZyqf6a9t2wZx1LVUNZWguSKVFYM5ZbnE/n0pThqIwP4JsDNKIY8lLXWAbP+HBQRklCLjQjBUshNy2kAXBZ24HNeYCRjLaF9hHkrVlzhKcYTFb5HGXV1sx6/K6XjOM1A6forgHrDQxRPd0Sc90R1f0SG//rFWLatS9VHm2G1rh57sO+1ZfP1WVeNb49Vv1X88aBUxGXiV79yOmfgunoa/sHT2vTq8M1b7TKT2x/xN6oFu+gVt5cc6WxcoxkvwB2b+f+yNYH8lkxzOjyyPpmbH4K9owgEEM83tPYAaLWEKOzz3AOa5xYySMH0bGoEaqkYg1vfgjjKl3ytWTRg==</latexit> Analysis Filter Bank <latexit sha1_base64="SvZ0psZWIG+uwFmilZwO65BHQhk=">AAACanichVFNLwNBGH66vuur6kJ6EUXq0syWIE4SiTi2qEqQZndNa2K/sjtt0PgDbk4SPZGIiJ/h4g84+AnCjcTFwdvtJoLgnczMM8+8zzvPzOiuKXzJ2ENEaWlta+/o7Ip29/T29ccG4uu+U/EMnjcc0/E2dM3nprB5Xgpp8g3X45qlm7yg7y029gtV7vnCsdfkgcu3La1si5IwNElUIbUk9vnOZDGWZGkWxMhPoIYgiTCyTuwKW9iBAwMVWOCwIQmb0OBT24QKBpe4bdSI8wiJYJ/jCFHSViiLU4ZG7B6NZVpthqxN60ZNP1AbdIpJ3SPlCMbZPbtmL+yO3bBH9v5rrVpQo+HlgGa9qeVusf94aPXtX5VFs8Tup+pPzxIlzAVeBXl3A6ZxC6Oprx6evqzOr4zXJtgFeyL/5+yB3dIN7OqrcZnjK3VE6QPU78/9E6xn0upMeiqXSS5Mh1/RiQRGkaL3nsUClpFFPnB3gjPUI89KXBlWEs1UJRJqBvEllLEPbUOL9Q==</latexit> (Fixed) <latexit sha1_base64="hdoUPd0PYdLW1yY0ywaVjITa0IY=">AAACe3ichVHLSgMxFD0dX7W+qoIIbopFEdGS1ieuCrpw2VqrgkqZmaYaOi9mpoVa+wP+gAtXCiKif+HGH3DhJ4jLCm4UvDMdEBX1hiQnJ/fcnCSKpQnHZewxJLW1d3R2hbsjPb19/QPRwaEtx6zYKs+rpmbaO4rscE0YPO8KV+M7ls1lXdH4tlJe9fa3q9x2hGlsujWL7+vygSFKQpVdogrRkfqeUoqtcVXoPjPrFSs2CtE4SzA/Yj9BMgBxBJExo1fYQxEmVFSgg8OAS1iDDIfaLpJgsIjbR504m5Dw9zkaiJC2QlmcMmRiyzQe0Go3YA1aezUdX63SKRp1m5QxTLAHds2a7J7dsCf29mutul/D81KjWWlpuVUYOBnNvf6r0ml2cfip+tOzixKWfa+CvFs+491CbemrR6fN3MrGRH2SXbBn8n/OHtkd3cCovqiXWb5xhgh9QPL7c/8EW6lEcjExl03F0/PBV4QxhnFM0XsvIY11ZJCnc49xgRvcht6luDQtzbRSpVCgGcaXkBY+AL8UkuA=</latexit> Decimation-based <latexit sha1_base64="ef9Vpx6If3H2ezTxFg3Ef5UpI/Q=">AAACd3ichVHLSsNAFD2N7/qKdSO4sFgUV2VSRcWVoAuXfVgVVEoSp3UwL5K0PoI/4A+4EAQFqeJnuPEHXPQTxKWCCC68TQOiot6QmTNn7rn3zIzmGMLzGWvEpLb2js6u7p54b1//wKA8lFjz7Kqr86JuG7a7oakeN4TFi77wDb7huFw1NYOva3tLzf31Gnc9YVur/qHDt021Yomy0FWfqJKcCLa0cnLZ3rc81aSGVuW4JKdYmoWR/AmUCKQQRdaW69jCDmzoqMIEhwWfsAEVHn2bUMDgELeNgDiXkAj3OY4RJ22VsjhlqMTu0Vih1WbEWrRu1vRCtU5dDPpdUiYxwR7YDXtm9+yWPbL3X2sFYY2ml0OatZaWO6XBk5HC678qk2Yfu5+qPz37KGM+9CrIuxMyzVPoLX3t6PS5sJCfCCbZJXsi/xeswe7oBFbtRb/K8fwZ4vQAyvfr/gnWMmllNj2dy6QWZ6Kn6MYoxjFF9z2HRawgiyL1PcA56riOvUlj0qQ01UqVYpFmGF9CUj4AoRiRgg==</latexit> Downsampling <latexit sha1_base64="ribSY8FjUsAXKyN8FxPzX+UhDdA=">AAACdnichVG7SgNBFD1ZXzE+kmgjCBIMUatwo6JiFbCxjMY8QCXsrhNd3Be7m0gM/oA/YCEWChrEz7DxByz8BLFU0MLCm82CqKh3mJkzZ+65c2ZGsXXN9YgeQlJXd09vX7g/MjA4NByNxUeKrlVzVFFQLd1yyorsCl0zRcHTPF2UbUfIhqKLkrK/0t4v1YXjapa54TVssW3Iu6ZW1VTZY6oSi+driiKbO4mSXBdVyzHcSixJafIj8RNkApBEEDkr1sIWdmBBRQ0GBEx4jHXIcLltIgOCzdw2msw5jDR/X+AIEdbWOEtwhszsPo+7vNoMWJPX7Zqur1b5FJ27w8oEUnRP1/RMd3RDj/T+a62mX6PtpcGz0tEKuxI9Hsu//qsyePaw96n607OHKpZ8rxp7t32mfQu1o68fnjznl9dTzSm6oCf2f04PdMs3MOsv6uWaWD9FhD8g8/25f4LibDqzkJ5bm01m54OvCGMck5jh915EFqvIocDnHuAMV2iF3qQJKSVNd1KlUKAZxZeQ6ANH6pDi</latexit> Subband Waveforms <latexit sha1_base64="ISgY1jRXK2J+GWB55Wh3nm6EM8g=">AAACa3ichVHLSsNAFD2Nr1pf1W5EXRRLxVW5rUXFVcGNS1tbLahIEscaTJOQTAu1+AMu3bjQjYKI+Blu/AEXfoKIqwpuXHibBkRFvWEyZ87cc+fMHc0xDU8SPYaUru6e3r5wf2RgcGh4JDo6tu7ZNVcXJd02bbesqZ4wDUuUpCFNUXZcoVY1U2xoB8vt/Y26cD3Dtoqy4YjtqlqxjD1DVyVT5Wy8qLoVIXeiCUqRH/GfIB2ABIJYtaPX2MIubOiooQoBC5KxCRUef5tIg+Awt40mcy4jw98XOEKEtTXOEpyhMnvA/wqvNgPW4nW7puerdT7F5OGyMo4kPdANteiebumJ3n+t1fRrtL00eNY6WuHsjByPr739q6ryLLH/qfrTs8QeFn2vBnt3fKZ9C72jrx+ettaWCsnmDF3SM/u/oEe64xtY9Vf9Ki8KZ4jwA6S/t/snWM+k0vOpuXwmkcsGTxHGJKYxy/1eQA4rWEXJ7/MJznAeelFiyoQy1UlVQoEmhi+hJD8AiBOMeQ==</latexit> 4 Target <latexit sha1_base64="5bv/Fn8RI0HR6kR253f7wpLXIZY=">AAACdHichVHLSsNAFD2N7/po1I2gi2KouLFMq6i4Ety4EeqjWqhSkjjW0MmDZFrQ4g/4Ay5cKRYRP8ONP+DCTxCXFd248DYNiIp6w2TOnLnnzpm5hiesQDL2GFM6Oru6e3r74v0Dg0MJdXhkO3Crvsnzpitcv2DoAReWw/PSkoIXPJ/rtiH4jlFZae3v1LgfWK6zJY88vmfrZcc6sExdElVSE2tczAQeN6Xvln3dLqkaS7Mwkj9BJgIaosi56jV2sQ8XJqqwweFAEhbQEdBXRAYMHnF7qBPnE7LCfY4TxElbpSxOGTqxFfqXaVWMWIfWrZpBqDbpFEHDJ2USKfbAbliT3bNb9sTef61VD2u0vBzRbLS13CslTsc23/5V2TRLHH6q/vQscYDF0KtF3r2Qad3CbOtrx2fNzaWNVH2KXbJn8n/BHtkd3cCpvZiNdb5xjjg1IPP9uX+C7Ww6M5+eXc9qy3NRK3oxjklM03svYBmryCEf9uQcV2jEXpUJRVNS7VQlFmlG8SWU9AejXJAn</latexit> Mel-spectrogram <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="DyyzWJsU+/UDYnrzOZlHdxaANSc=">AAACdXichVHLSsNAFD2Nr1pfUTeCCMWquKpTFRVXghuXfRhbUClJnNZgXiRpQEN/wB9woRuFKuJnuPEHXPgJ4rKCGxfepAFRUW/IzJkz99x7Zkaxdc31GHtKCF3dPb19yf7UwODQ8Ig4OrbjWg1H5ZJq6ZZTUWSX65rJJU/zdF6xHS4bis7LytFmuF/2ueNqlrntHdt835DrplbTVNkjqiqKwZ5SS0u2KxvUzqw3q2KGZVkU6Z8gF4MM4shb4g32cAALKhowwGHCI6xDhkvfLnJgsInbR0CcQ0iL9jmaSJG2QVmcMmRij2is02o3Zk1ahzXdSK1SF51+h5RpzLJHdsva7IHdsWf2/mutIKoRejmmWelouV0dOZ0ovf2rMmj2cPip+tOzhxrWIq8aebcjJjyF2tH7J2ft0npxNphjV+yF/F+yJ3ZPJzD9V7VV4MVzpOgBct+v+yfYWczmVrJLhcXMxnL8FElMYhrzdN+r2MAW8pCor48LtHCdeBOmhBlhrpMqJGLNOL6EsPABowmQmw==</latexit> Upsampling <latexit sha1_base64="Slc65VJzzRYHtCtTplG0z6/rHdk=">AAACcXichVFNSwJBGH7cvsw+tLoUXSQpgkBGi4pOQpeOfqQJarG7jTa47i67q2DiH+gPFHRSiIh+Rpf+QAd/QnQ06NKh13UhKqp3mJlnnnmfd56ZUUxN2A5jPZ80Mjo2PuGfDExNz8wGQ3PzOduoWyrPqoZmWHlFtrkmdJ51hKPxvGlxuaZo/Eip7g/2jxrcsoWhHzpNk5dqckUXZaHKDlHHraJSDqe5LU7rstY+CUVYlLkR/gliHojAi6QRukURpzCgoo4aOHQ4hDXIsKkVEAODSVwJLeIsQsLd52gjQNo6ZXHKkImt0lihVcFjdVoPatquWqVTNOoWKcNYZU/sjvXZI7tnz+z911ott8bAS5NmZajl5knwYjHz9q+qRrODs0/Vn54dlLHrehXk3XSZwS3Uob5xftnP7KVXW2usy17If4f12APdQG+8qjcpnr5GgD4g9v25f4JcPBrbjm6m4pHElvcVfixjBev03jtI4ABJZOlcC1fooOvrS0tSWFoZpko+T7OALyFtfAD3Uo9v</latexit> Residual <latexit sha1_base64="X6pW9DuNIJuzqc/uIQxMKdiBnNA=">AAACbnichVHLSsNAFD2Nr1ofrQoiiFgsFVdlWkXFVdGNyz6sCrWUJE5raF4kaaGW/oB7cSEoCiLiZ7jxB1z0E8SNUMGNC2/TgGhRb5jMmTP33DlzRzJVxXYYa/mEvv6BwSH/cGBkdGw8GJqY3LWNqiXznGyohrUviTZXFZ3nHMVR+b5pcVGTVL4nVbY6+3s1btmKoe84dZMXNLGsKyVFFh2i8o0DqRTeVA250iyGIizG3Aj3grgHIvAiZYRucYBDGJBRhQYOHQ5hFSJs+vKIg8EkroAGcRYhxd3naCJA2iplccoQia3Qv0yrvMfqtO7UtF21TKeoNCxShhFlT+yOtdkju2fP7OPXWg23RsdLnWapq+VmMXgyk33/V6XR7ODoS/WnZwclrLteFfJuukznFnJXXzs+a2c3MtHGIrtmL+T/irXYA91Ar73JN2meOUeAHiD+s929YDcRi6/GltOJSHLFewo/ZrGAJer3GpLYRgo5t2OnuMCl71WYFuaE+W6q4PM0U/gWwtIn3M+OAw==</latexit> Block <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="4W8kVIAFDYKqxJRx+bHFCFn2NAg=">AAACdnichVHLSsNAFD2N7/po1Y0gSLFUXZVbLSquBDcutVoVrJQkTjWYJiGZ1kfoD/gDLsSFghbxM9z4Ay78BHGpoAsX3qYBUVHvMDNnztxz58yM5piGJ4keIkpLa1t7R2dXtLunty8W7x9Y8+yKq4u8bpu2u6GpnjANS+SlIU2x4bhCLWumWNf2Fhr761XheoZtrcpDR2yV1R3LKBm6KpkqxvsLUhxI3y9opYRUrd1arRhPUpqCSPwEmRAkEcaSHa+jgG3Y0FFBGQIWJGMTKjxum8iA4DC3BZ85l5ER7AvUEGVthbMEZ6jM7vG4w6vNkLV43ajpBWqdTzG5u6xMIEX3dE3PdEc39Ejvv9bygxoNL4c8a02tcIqx46GV139VZZ4ldj9Vf3qWKGE28GqwdydgGrfQm/rq0cnzylwu5Y/RBT2x/3N6oFu+gVV90S+XRe4UUf6AzPfn/gnWJtOZ6fTUcjY5nw2/ohPDGMUEv/cM5rGIJeT53H2c4Qr1yJsyoqSU8WaqEgk1g/gSCn0AG36RSw==</latexit> tanh <latexit sha1_base64="DyyzWJsU+/UDYnrzOZlHdxaANSc=">AAACdXichVHLSsNAFD2Nr1pfUTeCCMWquKpTFRVXghuXfRhbUClJnNZgXiRpQEN/wB9woRuFKuJnuPEHXPgJ4rKCGxfepAFRUW/IzJkz99x7Zkaxdc31GHtKCF3dPb19yf7UwODQ8Ig4OrbjWg1H5ZJq6ZZTUWSX65rJJU/zdF6xHS4bis7LytFmuF/2ueNqlrntHdt835DrplbTVNkjqiqKwZ5SS0u2KxvUzqw3q2KGZVkU6Z8gF4MM4shb4g32cAALKhowwGHCI6xDhkvfLnJgsInbR0CcQ0iL9jmaSJG2QVmcMmRij2is02o3Zk1ahzXdSK1SF51+h5RpzLJHdsva7IHdsWf2/mutIKoRejmmWelouV0dOZ0ovf2rMmj2cPip+tOzhxrWIq8aebcjJjyF2tH7J2ft0npxNphjV+yF/F+yJ3ZPJzD9V7VV4MVzpOgBct+v+yfYWczmVrJLhcXMxnL8FElMYhrzdN+r2MAW8pCor48LtHCdeBOmhBlhrpMqJGLNOL6EsPABowmQmw==</latexit> Upsampling <latexit sha1_base64="wNZ9eSoQI7ZL2wpRp6ZdgmqvoBI=">AAACfXichVHLSsNAFD2Nr1ofrboR3BRLxYWWaRUrrgQ3LuujWmxLSdJpHZomIUkLtegH+AMuXCmKiOhPuPEHXPgJ4lLBjaA3aUBU1DvMzJkz99w5M6OYmrAdxh4CUld3T29fsD80MDg0HI6MjG7ZRsNSeVY1NMPKKbLNNaHzrCMcjedMi8t1RePbSm3F3d9ucssWhr7ptExerMtVXVSEKjtElSLj7YJSie5wy5jNyOWy0KuzbrnyfikSYwnmRfQnSPogBj8yRuQCBZRhQEUDdXDocAhrkGFTyyMJBpO4ItrEWYSEt8+xjxBpG5TFKUMmtkZjlVZ5n9Vp7da0PbVKp2jULVJGEWf37JI9szt2xR7Z26+12l4N10uLZqWj5WYpfDi+8fqvqk6zg91P1Z+eHVSw6HkV5N30GPcWakff3Dt63lhaj7en2Cl7Iv8n7IHd0g305ot6vsbXjxGiD0h+f+6fYCuVSC4k5tZSseV5/yuCmMAkpum901jGKjLI0rkHOMM1bgLvUlyakRKdVCnga8bwJaT0BycCk3s=</latexit> Zero-Padding-based <latexit sha1_base64="ZQ2XrMynS7M7LG7YPD1yMVw5FSs=">AAACbnichVHLSsNAFD2Nr1pfVUEEEcVScVUmKiquBDcubWtVqFKSOLZD0yQk00Jb/AH34kJQFETEz3DjD7joJ4gboYIbF96mAVFRb5jMmTP33DlzR3dM4UnGGiGlo7OruyfcG+nrHxgcig6PbHt22TV4xrBN293VNY+bwuIZKaTJdx2XayXd5Dt6cb21v1Phridsa0tWHb5f0vKWOBSGJonKpquWLHBP1PhBLhpjCebH9E+gBiCGIDbt6A32cAAbBsoogcOCJGxCg0dfFioYHOL2USfOJST8fY4jREhbpixOGRqxRfrnaZUNWIvWrZqerzboFJOGS8ppxNkju2VN9sDu2BN7/7VW3a/R8lKlWW9ruZMbOh5Pv/2rKtEsUfhU/elZ4hArvldB3h2fad3CaOsrtdNmejUVr8+yK/ZM/i9Zg93TDazKq3Gd5KkzROgB1O/t/gm25xPqUmIhOR9bWwyeIowJzGCO+r2MNWxgExm/Yyc4x0XoRRlTJpWpdqoSCjSj+BLK3AfFpo52</latexit> Synthesized <latexit sha1_base64="s5ApCbZZx5L/zNvoq+CKUJcKDQ0=">AAACa3ichVG7SgNBFD1ZXzE+Ek0jahEMEaswiaJiFbCxzMM8IIawu050yb7Y3QRi8AcsbSxioyAifoaNP2CRTxCximBj4c1mQTSod5mdM2fuuXPmjmSqiu0w1vUJI6Nj4xP+ycDU9MxsMDQ3X7CNhiXzvGyohlWSRJuris7zjuKovGRaXNQklRel+m5/v9jklq0Y+r7TMnlFE490pabIokNUqSg2ec2wtGooyuLMjcgwSHggCi/SRugWBziEARkNaODQ4RBWIcKmr4wEGEziKmgTZxFS3H2OUwRI26AsThkisXX6H9Gq7LE6rfs1bVct0ykqDYuUEcTYE7tjPfbI7tkz+/i1Vtut0ffSolkaaLlZDZ4t5N7/VWk0Ozj+Uv3p2UEN265XhbybLtO/hTzQN08uermdbKy9yq7ZC/m/Yl32QDfQm2/yTYZnOwjQAyR+tnsYFJLxxGZ8PZOMpja8p/BjCStYo35vIYU9pJF3+3yODi59r0JYWBSWB6mCz9OE8S2E2CejUI0F</latexit> Waveform <latexit sha1_base64="xIhSSitPT2rOrGV3sdAxXYBVdbc=">AAACgHichVG7SgNBFD1Z3/GRqI1gsxgUqzgbRcVKFMQyD2MElbC7TnTIZnfZnQRisLD1ByysFETERr/Bxh+wyCeIpYKNhTebBVFR7zAzZ87cc+fMjOFawpeMNSNKR2dXd09vX7R/YHAoFh8e2fSdqmfyvOlYjrdl6D63hM3zUkiLb7ke1yuGxQtGebW1X6hxzxeOvSHrLt+t6Pu2KAlTl0QV4+ONHaOk5uq2POC+8NU1YUnuqSu6XT4qxhMsyYJQfwItBAmEkXbiV9jBHhyYqKICDhuSsAUdPrVtaGBwidtFgziPkAj2OY4QJW2Vsjhl6MSWadyn1XbI2rRu1fQDtUmnWNQ9UqqYZI/smr2wB3bDntj7r7UaQY2WlzrNRlvL3WLsZCz39q+qQrPEwafqT88SJSwGXgV5dwOmdQuzra8dnr7klrKTjSl2wZ7J/zlrsnu6gV17NS8zPHuGKH2A9v25f4LNVFKbT85mUonlufArejGOCUzTey9gGetII0/nHuMKt7hTFGVamVG0dqoSCTWj+BLK0gcJZJPW</latexit> Synthesis Filter Bank <latexit sha1_base64="SvZ0psZWIG+uwFmilZwO65BHQhk=">AAACanichVFNLwNBGH66vuur6kJ6EUXq0syWIE4SiTi2qEqQZndNa2K/sjtt0PgDbk4SPZGIiJ/h4g84+AnCjcTFwdvtJoLgnczMM8+8zzvPzOiuKXzJ2ENEaWlta+/o7Ip29/T29ccG4uu+U/EMnjcc0/E2dM3nprB5Xgpp8g3X45qlm7yg7y029gtV7vnCsdfkgcu3La1si5IwNElUIbUk9vnOZDGWZGkWxMhPoIYgiTCyTuwKW9iBAwMVWOCwIQmb0OBT24QKBpe4bdSI8wiJYJ/jCFHSViiLU4ZG7B6NZVpthqxN60ZNP1AbdIpJ3SPlCMbZPbtmL+yO3bBH9v5rrVpQo+HlgGa9qeVusf94aPXtX5VFs8Tup+pPzxIlzAVeBXl3A6ZxC6Oprx6evqzOr4zXJtgFeyL/5+yB3dIN7OqrcZnjK3VE6QPU78/9E6xn0upMeiqXSS5Mh1/RiQRGkaL3nsUClpFFPnB3gjPUI89KXBlWEs1UJRJqBvEllLEPbUOL9Q==</latexit> (Fixed) <latexit sha1_base64="HWXqYG4k2bKbVOswmC5CBPTuGt8=">AAACcHichVHLSgMxFD0dX7U+WnUjuLBaFHFR0lpUXBXcuOzDqqBFZsbYhk5nxpm00BZ/wB9w4UYFEfEz3PgDLvoJ4k4FNy68nQ6IinpDkpOTe25OEs02hCsZaweUnt6+/oHgYGhoeGQ0HBkb33KtmqPzgm4ZlrOjqS43hMkLUkiD79gOV6uawbe1ynpnf7vOHVdY5qZs2LxYVUumOBS6KokqpqL5hinL3BVNfrAfibE48yL6EyR8EIMfGStyjT0cwIKOGqrgMCEJG1DhUttFAgw2cUW0iHMICW+f4xgh0tYoi1OGSmyFxhKtdn3WpHWnpuupdTrFoO6QMoo59sBu2Au7Z7fskb3/Wqvl1eh4adCsdbXc3g+fTObf/lVVaZYof6r+9CxxiFXPqyDvtsd0bqF39fXm6Ut+LTfXmmeX7In8X7A2u6MbmPVX/SrLc2cI0Qckvj/3T7CVjCeW40vZZCyd8r8iiCnMYoHeewVpbCCDAp17hFOc4yLwrEwq08pMN1UJ+JoJfAll8QO8b47e</latexit> 4 Synthesized <latexit sha1_base64="ribSY8FjUsAXKyN8FxPzX+UhDdA=">AAACdnichVG7SgNBFD1ZXzE+kmgjCBIMUatwo6JiFbCxjMY8QCXsrhNd3Be7m0gM/oA/YCEWChrEz7DxByz8BLFU0MLCm82CqKh3mJkzZ+65c2ZGsXXN9YgeQlJXd09vX7g/MjA4NByNxUeKrlVzVFFQLd1yyorsCl0zRcHTPF2UbUfIhqKLkrK/0t4v1YXjapa54TVssW3Iu6ZW1VTZY6oSi+driiKbO4mSXBdVyzHcSixJafIj8RNkApBEEDkr1sIWdmBBRQ0GBEx4jHXIcLltIgOCzdw2msw5jDR/X+AIEdbWOEtwhszsPo+7vNoMWJPX7Zqur1b5FJ27w8oEUnRP1/RMd3RDj/T+a62mX6PtpcGz0tEKuxI9Hsu//qsyePaw96n607OHKpZ8rxp7t32mfQu1o68fnjznl9dTzSm6oCf2f04PdMs3MOsv6uWaWD9FhD8g8/25f4LibDqzkJ5bm01m54OvCGMck5jh915EFqvIocDnHuAMV2iF3qQJKSVNd1KlUKAZxZeQ6ANH6pDi</latexit> Subband Waveforms <latexit sha1_base64="FLUJZEOdq5RME9XU3pHl9q//TQ0=">AAACe3ichVHLSgMxFD0d3/XRqiCCm2KpiEhJ6xNXigvdKK3aKrSlzIxpHZzODDNpQas/4A+4cKUgIvoXbvwBF/0EcVnBjYK30wHRot6Q5OTknpuTRLF0zRGM1XxSW3tHZ1d3j7+3r38gEBwcSjtm2VZ5SjV1095TZIfrmsFTQhM637NsLpcUne8qh6uN/d0Ktx3NNHbEkcVzJbloaAVNlQVR+eBINasUQhtcX1vZDK1xg9uyMO3TfDDMosyNUCuIeSAMLxJm8AZZ7MOEijJK4DAgCOuQ4VDLIAYGi7gcqsTZhDR3n+MUftKWKYtThkzsIY1FWmU81qB1o6bjqlU6RadukzKECHtit6zOHtkde2bvv9aqujUaXo5oVppabuUDZ6Pbb/+qSjQLHHyp/vQsUMCi61Uj75bLNG6hNvWV4/P69tJWpDrBrtgL+b9kNfZANzAqr+p1km9dwE8fEPv53K0gHY/G5qMzyXh4edb7im6MYRyT9N4LWMY6EkjRuSe4wh3ufR9SWJqSppupks/TDONbSHOf3HOScg==</latexit> MelGAN Generator <latexit sha1_base64="dVWEVtnZAyvBtUuy105S2N1KkVU=">AAACbHichVHLSgMxFD0d3/VVHwuhCMVScVVSFRVXBUFcuGhta5VaZGZMNTgvJtOCFn/ArQsX6kJBRPwMN/6ACz9BBDcKblx4Ox0QFfWGJCcn99ycJJpjCOkx9hBSWlrb2js6u8LdPb19/ZGBwVVpV12dF3TbsN01TZXcEBYveMIz+JrjctXUDF7Udhca+8Uad6Wwrby35/CyqW5boiJ01SNqPZdfzMeWbSk3I3GWZH7EfoJUAOIIImNHrrCBLdjQUYUJDgseYQMqJLUSUmBwiCujTpxLSPj7HAcIk7ZKWZwyVGJ3adymVSlgLVo3akpfrdMpBnWXlDEk2D27Zi/sjt2wR/b+a626X6PhZY9mranlzmb/4Uju7V+VSbOHnU/Vn549VDDnexXk3fGZxi30pr62f/ySm19J1MfZBXsi/+fsgd3SDazaq36Z5SsnCNMHpL4/90+wOplMzSSnspPx9HTwFZ2IYgwT9N6zSGMJGRToXBNHOMVZ6FkZVqLKaDNVCQWaIXwJZfwDPpSMyg==</latexit> STFT Loss <latexit sha1_base64="AOiF5VNDxrumn6UBOsgP3Nnx9H4=">AAACjHicSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQuoayRqKviW5pRk6iYl5qUo+KbmuDv6Kbin5qUWJZbkFyn4pZaU5xdlxwsoG+gZgIECJsMQylBmgIKAfIHlDDEMKQz5DMkMpQy5DKkMeQwlQHYOQyJDMRBGMxgyGDAUAMViGaqBYkVAViZYPpWhloELqLcUqCoVqCIRKJoNJNOBvGioaB6QDzKzGKw7GWhLDhAXAXUqMKgaXDVYafDZ4ITBaoOXBn9wmlUNNgPklkognQTRm1oQz98lEfydoK5cIF3CkIHQhdfNJQxpDBZgt2YC3V4AFgH5Ihmiv6xq+udgqyDVajWDRQavge5faHDT4DDQB3llX5KXBqYGzWbgAkaAIXpwYzLCjPQMzfSMA42UHaygUcHBIM2gxKABDG9zBgcGD4YAhlCgvb0Mmxn2MOxl4mMyYbJmsoUoZWKE6hFmQAFMbgD0OJew</latexit> (a) Multi-band MelGAN Generator Network <latexit sha1_base64="bjbCykvuOkou9Qq6vXkWketNYX0=">AAACcHichVHLSgMxFD0d3/XRqhvBhdVSERclo6LiSnDj0lcfUEuZGdManGbGmWmhFn/AH+jCjQoi4me48Qdc+AnizgpuXHg7HRAt6g1JTk7uuTlJdNsUrsfYU0jp6u7p7esfCA8ODY9EoqNjadeqOAZPGZZpOVldc7kpJE95wjN51na4VtZNntGPNlr7mSp3XGHJPa9m83xZK0lRFIbmEZXfczQhhSzFLGnWCtE4SzI/Yp1ADUAcQWxZ0Rvs4wAWDFRQBoeER9iEBpdaDioYbOLyqBPnEBL+PscpwqStUBanDI3YIxpLtMoFrKR1q6brqw06xaTukDKGBHtkt6zJHtgde2Yfv9aq+zVaXmo0620ttwuRs4nd939VZZo9HH6p/vTsoYhV36sg77bPtG5htPXVk0Zzd20nUZ9lV+yF/F+yJ3ZPN5DVN+N6m++cI0wfoP587k6QXkiqy8nF7YX4+lLwFf2YxAzm6L1XsI5NbCFF5x6jgQtchl6VCWVKmW6nKqFAM45vocx/AiAWjw4=</latexit> Training only
  8. Simply replacing fi xed synthesis fi lter bank to a

    trainable CNN layer Synthesis fi lter bank is a mixture of FIR fi lters and is equivalent to a CNN layer Same inference speed as Multi-band MelGAN Same discriminators as Multi-band MelGAN Successfully trained without subband STFT loss Proposed Multi-stream MelGAN <latexit sha1_base64="zalZsOwrTJnssA7Or2DptbCUKH8=">AAACaXichVFNLwNBGH66vqq+ikvDpbEhTs0sgjhJXBz7TULT7K5Rw3Z3szttUo0/4OQmOJGIiJ/h4g84+AnSI4mLg7fbTQTBO5mZZ555n3eemTFcS/iSsaeI0tXd09sX7Y8NDA4Nj8RHx4q+U/NMXjAdy/E2Dd3nlrB5QQpp8U3X43rVsPiGcbDW3t+oc88Xjp2XDZeXqnrFFrvC1CVRxbzuVbgsx1WWYkEkfwItBCrCSDvxG2xjBw5M1FAFhw1J2IIOn9oWNDC4xJXQJM4jJIJ9jiPESFujLE4ZOrEHNFZotRWyNq3bNf1AbdIpFnWPlElMs0d2y17YA7tjz+z911rNoEbbS4Nmo6PlbnnkOJF7+1dVpVli71P1p2eJXSwHXgV5dwOmfQuzo68fnr7kVrLTzRl2xVrk/5I9sXu6gV1/Na8zPHuBGH2A9v25f4LiXEpbTM1n5tTVhfAropjEFGbpvZewinWkUaBz93GCM5xHWsqoklAmOqlKJNSM40so6geTAowR</latexit> Target <latexit sha1_base64="s5ApCbZZx5L/zNvoq+CKUJcKDQ0=">AAACa3ichVG7SgNBFD1ZXzE+Ek0jahEMEaswiaJiFbCxzMM8IIawu050yb7Y3QRi8AcsbSxioyAifoaNP2CRTxCximBj4c1mQTSod5mdM2fuuXPmjmSqiu0w1vUJI6Nj4xP+ycDU9MxsMDQ3X7CNhiXzvGyohlWSRJuris7zjuKovGRaXNQklRel+m5/v9jklq0Y+r7TMnlFE490pabIokNUqSg2ec2wtGooyuLMjcgwSHggCi/SRugWBziEARkNaODQ4RBWIcKmr4wEGEziKmgTZxFS3H2OUwRI26AsThkisXX6H9Gq7LE6rfs1bVct0ykqDYuUEcTYE7tjPfbI7tkz+/i1Vtut0ffSolkaaLlZDZ4t5N7/VWk0Ozj+Uv3p2UEN265XhbybLtO/hTzQN08uermdbKy9yq7ZC/m/Yl32QDfQm2/yTYZnOwjQAyR+tnsYFJLxxGZ8PZOMpja8p/BjCStYo35vIYU9pJF3+3yODi59r0JYWBSWB6mCz9OE8S2E2CejUI0F</latexit> Waveform <latexit sha1_base64="dWj55yBlxJbUcxQjr3b+lPnnHSE=">AAACf3ichVHLSiNBFD1pddTojFE3opvG4IyrcKPia+UDxKWvqKASunsqTpFKd9NdCcQguPYHXLhSUBEX+g9u/AEXfoK4VHDjwptOwzAjM96iqk6duufWqSrbVzLURA8Jo6m55UtrW3uyo/Prt65Ud8966JUDR+QcT3nBpm2FQklX5LTUSmz6gbBKthIbdnG+vr9REUEoPXdNV32xU7J2XVmQjqWZyqf6a9t2wZx1LVUNZWguSKVFYM5ZbnE/n0pThqIwP4JsDNKIY8lLXWAbP+HBQRklCLjQjBUshNy2kAXBZ24HNeYCRjLaF9hHkrVlzhKcYTFb5HGXV1sx6/K6XjOM1A6forgHrDQxRPd0Sc90R1f0SG//rFWLatS9VHm2G1rh57sO+1ZfP1WVeNb49Vv1X88aBUxGXiV79yOmfgunoa/sHT2vTq8M1b7TKT2x/xN6oFu+gVt5cc6WxcoxkvwB2b+f+yNYH8lkxzOjyyPpmbH4K9owgEEM83tPYAaLWEKOzz3AOa5xYySMH0bGoEaqkYg1vfgjjKl3ytWTRg==</latexit> Analysis Filter Bank <latexit sha1_base64="SvZ0psZWIG+uwFmilZwO65BHQhk=">AAACanichVFNLwNBGH66vuur6kJ6EUXq0syWIE4SiTi2qEqQZndNa2K/sjtt0PgDbk4SPZGIiJ/h4g84+AnCjcTFwdvtJoLgnczMM8+8zzvPzOiuKXzJ2ENEaWlta+/o7Ip29/T29ccG4uu+U/EMnjcc0/E2dM3nprB5Xgpp8g3X45qlm7yg7y029gtV7vnCsdfkgcu3La1si5IwNElUIbUk9vnOZDGWZGkWxMhPoIYgiTCyTuwKW9iBAwMVWOCwIQmb0OBT24QKBpe4bdSI8wiJYJ/jCFHSViiLU4ZG7B6NZVpthqxN60ZNP1AbdIpJ3SPlCMbZPbtmL+yO3bBH9v5rrVpQo+HlgGa9qeVusf94aPXtX5VFs8Tup+pPzxIlzAVeBXl3A6ZxC6Oprx6evqzOr4zXJtgFeyL/5+yB3dIN7OqrcZnjK3VE6QPU78/9E6xn0upMeiqXSS5Mh1/RiQRGkaL3nsUClpFFPnB3gjPUI89KXBlWEs1UJRJqBvEllLEPbUOL9Q==</latexit> (Fixed) <latexit sha1_base64="hdoUPd0PYdLW1yY0ywaVjITa0IY=">AAACe3ichVHLSgMxFD0dX7W+qoIIbopFEdGS1ieuCrpw2VqrgkqZmaYaOi9mpoVa+wP+gAtXCiKif+HGH3DhJ4jLCm4UvDMdEBX1hiQnJ/fcnCSKpQnHZewxJLW1d3R2hbsjPb19/QPRwaEtx6zYKs+rpmbaO4rscE0YPO8KV+M7ls1lXdH4tlJe9fa3q9x2hGlsujWL7+vygSFKQpVdogrRkfqeUoqtcVXoPjPrFSs2CtE4SzA/Yj9BMgBxBJExo1fYQxEmVFSgg8OAS1iDDIfaLpJgsIjbR504m5Dw9zkaiJC2QlmcMmRiyzQe0Go3YA1aezUdX63SKRp1m5QxTLAHds2a7J7dsCf29mutul/D81KjWWlpuVUYOBnNvf6r0ml2cfip+tOzixKWfa+CvFs+491CbemrR6fN3MrGRH2SXbBn8n/OHtkd3cCovqiXWb5xhgh9QPL7c/8EW6lEcjExl03F0/PBV4QxhnFM0XsvIY11ZJCnc49xgRvcht6luDQtzbRSpVCgGcaXkBY+AL8UkuA=</latexit> Decimation-based <latexit sha1_base64="ef9Vpx6If3H2ezTxFg3Ef5UpI/Q=">AAACd3ichVHLSsNAFD2N7/qKdSO4sFgUV2VSRcWVoAuXfVgVVEoSp3UwL5K0PoI/4A+4EAQFqeJnuPEHXPQTxKWCCC68TQOiot6QmTNn7rn3zIzmGMLzGWvEpLb2js6u7p54b1//wKA8lFjz7Kqr86JuG7a7oakeN4TFi77wDb7huFw1NYOva3tLzf31Gnc9YVur/qHDt021Yomy0FWfqJKcCLa0cnLZ3rc81aSGVuW4JKdYmoWR/AmUCKQQRdaW69jCDmzoqMIEhwWfsAEVHn2bUMDgELeNgDiXkAj3OY4RJ22VsjhlqMTu0Vih1WbEWrRu1vRCtU5dDPpdUiYxwR7YDXtm9+yWPbL3X2sFYY2ml0OatZaWO6XBk5HC678qk2Yfu5+qPz37KGM+9CrIuxMyzVPoLX3t6PS5sJCfCCbZJXsi/xeswe7oBFbtRb/K8fwZ4vQAyvfr/gnWMmllNj2dy6QWZ6Kn6MYoxjFF9z2HRawgiyL1PcA56riOvUlj0qQ01UqVYpFmGF9CUj4AoRiRgg==</latexit> Downsampling <latexit sha1_base64="ribSY8FjUsAXKyN8FxPzX+UhDdA=">AAACdnichVG7SgNBFD1ZXzE+kmgjCBIMUatwo6JiFbCxjMY8QCXsrhNd3Be7m0gM/oA/YCEWChrEz7DxByz8BLFU0MLCm82CqKh3mJkzZ+65c2ZGsXXN9YgeQlJXd09vX7g/MjA4NByNxUeKrlVzVFFQLd1yyorsCl0zRcHTPF2UbUfIhqKLkrK/0t4v1YXjapa54TVssW3Iu6ZW1VTZY6oSi+driiKbO4mSXBdVyzHcSixJafIj8RNkApBEEDkr1sIWdmBBRQ0GBEx4jHXIcLltIgOCzdw2msw5jDR/X+AIEdbWOEtwhszsPo+7vNoMWJPX7Zqur1b5FJ27w8oEUnRP1/RMd3RDj/T+a62mX6PtpcGz0tEKuxI9Hsu//qsyePaw96n607OHKpZ8rxp7t32mfQu1o68fnjznl9dTzSm6oCf2f04PdMs3MOsv6uWaWD9FhD8g8/25f4LibDqzkJ5bm01m54OvCGMck5jh915EFqvIocDnHuAMV2iF3qQJKSVNd1KlUKAZxZeQ6ANH6pDi</latexit> Subband Waveforms <latexit sha1_base64="ISgY1jRXK2J+GWB55Wh3nm6EM8g=">AAACa3ichVHLSsNAFD2Nr1pf1W5EXRRLxVW5rUXFVcGNS1tbLahIEscaTJOQTAu1+AMu3bjQjYKI+Blu/AEXfoKIqwpuXHibBkRFvWEyZ87cc+fMHc0xDU8SPYaUru6e3r5wf2RgcGh4JDo6tu7ZNVcXJd02bbesqZ4wDUuUpCFNUXZcoVY1U2xoB8vt/Y26cD3Dtoqy4YjtqlqxjD1DVyVT5Wy8qLoVIXeiCUqRH/GfIB2ABIJYtaPX2MIubOiooQoBC5KxCRUef5tIg+Awt40mcy4jw98XOEKEtTXOEpyhMnvA/wqvNgPW4nW7puerdT7F5OGyMo4kPdANteiebumJ3n+t1fRrtL00eNY6WuHsjByPr739q6ryLLH/qfrTs8QeFn2vBnt3fKZ9C72jrx+ettaWCsnmDF3SM/u/oEe64xtY9Vf9Ki8KZ4jwA6S/t/snWM+k0vOpuXwmkcsGTxHGJKYxy/1eQA4rWEXJ7/MJznAeelFiyoQy1UlVQoEmhi+hJD8AiBOMeQ==</latexit> 4 Target <latexit sha1_base64="5bv/Fn8RI0HR6kR253f7wpLXIZY=">AAACdHichVHLSsNAFD2N7/po1I2gi2KouLFMq6i4Ety4EeqjWqhSkjjW0MmDZFrQ4g/4Ay5cKRYRP8ONP+DCTxCXFd248DYNiIp6w2TOnLnnzpm5hiesQDL2GFM6Oru6e3r74v0Dg0MJdXhkO3Crvsnzpitcv2DoAReWw/PSkoIXPJ/rtiH4jlFZae3v1LgfWK6zJY88vmfrZcc6sExdElVSE2tczAQeN6Xvln3dLqkaS7Mwkj9BJgIaosi56jV2sQ8XJqqwweFAEhbQEdBXRAYMHnF7qBPnE7LCfY4TxElbpSxOGTqxFfqXaVWMWIfWrZpBqDbpFEHDJ2USKfbAbliT3bNb9sTef61VD2u0vBzRbLS13CslTsc23/5V2TRLHH6q/vQscYDF0KtF3r2Qad3CbOtrx2fNzaWNVH2KXbJn8n/BHtkd3cCpvZiNdb5xjjg1IPP9uX+C7Ww6M5+eXc9qy3NRK3oxjklM03svYBmryCEf9uQcV2jEXpUJRVNS7VQlFmlG8SWU9AejXJAn</latexit> Mel-spectrogram <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="DyyzWJsU+/UDYnrzOZlHdxaANSc=">AAACdXichVHLSsNAFD2Nr1pfUTeCCMWquKpTFRVXghuXfRhbUClJnNZgXiRpQEN/wB9woRuFKuJnuPEHXPgJ4rKCGxfepAFRUW/IzJkz99x7Zkaxdc31GHtKCF3dPb19yf7UwODQ8Ig4OrbjWg1H5ZJq6ZZTUWSX65rJJU/zdF6xHS4bis7LytFmuF/2ueNqlrntHdt835DrplbTVNkjqiqKwZ5SS0u2KxvUzqw3q2KGZVkU6Z8gF4MM4shb4g32cAALKhowwGHCI6xDhkvfLnJgsInbR0CcQ0iL9jmaSJG2QVmcMmRij2is02o3Zk1ahzXdSK1SF51+h5RpzLJHdsva7IHdsWf2/mutIKoRejmmWelouV0dOZ0ovf2rMmj2cPip+tOzhxrWIq8aebcjJjyF2tH7J2ft0npxNphjV+yF/F+yJ3ZPJzD9V7VV4MVzpOgBct+v+yfYWczmVrJLhcXMxnL8FElMYhrzdN+r2MAW8pCor48LtHCdeBOmhBlhrpMqJGLNOL6EsPABowmQmw==</latexit> Upsampling <latexit sha1_base64="Slc65VJzzRYHtCtTplG0z6/rHdk=">AAACcXichVFNSwJBGH7cvsw+tLoUXSQpgkBGi4pOQpeOfqQJarG7jTa47i67q2DiH+gPFHRSiIh+Rpf+QAd/QnQ06NKh13UhKqp3mJlnnnmfd56ZUUxN2A5jPZ80Mjo2PuGfDExNz8wGQ3PzOduoWyrPqoZmWHlFtrkmdJ51hKPxvGlxuaZo/Eip7g/2jxrcsoWhHzpNk5dqckUXZaHKDlHHraJSDqe5LU7rstY+CUVYlLkR/gliHojAi6QRukURpzCgoo4aOHQ4hDXIsKkVEAODSVwJLeIsQsLd52gjQNo6ZXHKkImt0lihVcFjdVoPatquWqVTNOoWKcNYZU/sjvXZI7tnz+z911ott8bAS5NmZajl5knwYjHz9q+qRrODs0/Vn54dlLHrehXk3XSZwS3Uob5xftnP7KVXW2usy17If4f12APdQG+8qjcpnr5GgD4g9v25f4JcPBrbjm6m4pHElvcVfixjBev03jtI4ABJZOlcC1fooOvrS0tSWFoZpko+T7OALyFtfAD3Uo9v</latexit> Residual <latexit sha1_base64="X6pW9DuNIJuzqc/uIQxMKdiBnNA=">AAACbnichVHLSsNAFD2Nr1ofrQoiiFgsFVdlWkXFVdGNyz6sCrWUJE5raF4kaaGW/oB7cSEoCiLiZ7jxB1z0E8SNUMGNC2/TgGhRb5jMmTP33DlzRzJVxXYYa/mEvv6BwSH/cGBkdGw8GJqY3LWNqiXznGyohrUviTZXFZ3nHMVR+b5pcVGTVL4nVbY6+3s1btmKoe84dZMXNLGsKyVFFh2i8o0DqRTeVA250iyGIizG3Aj3grgHIvAiZYRucYBDGJBRhQYOHQ5hFSJs+vKIg8EkroAGcRYhxd3naCJA2iplccoQia3Qv0yrvMfqtO7UtF21TKeoNCxShhFlT+yOtdkju2fP7OPXWg23RsdLnWapq+VmMXgyk33/V6XR7ODoS/WnZwclrLteFfJuukznFnJXXzs+a2c3MtHGIrtmL+T/irXYA91Ar73JN2meOUeAHiD+s929YDcRi6/GltOJSHLFewo/ZrGAJer3GpLYRgo5t2OnuMCl71WYFuaE+W6q4PM0U/gWwtIn3M+OAw==</latexit> Block <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="4W8kVIAFDYKqxJRx+bHFCFn2NAg=">AAACdnichVHLSsNAFD2N7/po1Y0gSLFUXZVbLSquBDcutVoVrJQkTjWYJiGZ1kfoD/gDLsSFghbxM9z4Ay78BHGpoAsX3qYBUVHvMDNnztxz58yM5piGJ4keIkpLa1t7R2dXtLunty8W7x9Y8+yKq4u8bpu2u6GpnjANS+SlIU2x4bhCLWumWNf2Fhr761XheoZtrcpDR2yV1R3LKBm6KpkqxvsLUhxI3y9opYRUrd1arRhPUpqCSPwEmRAkEcaSHa+jgG3Y0FFBGQIWJGMTKjxum8iA4DC3BZ85l5ER7AvUEGVthbMEZ6jM7vG4w6vNkLV43ajpBWqdTzG5u6xMIEX3dE3PdEc39Ejvv9bygxoNL4c8a02tcIqx46GV139VZZ4ldj9Vf3qWKGE28GqwdydgGrfQm/rq0cnzylwu5Y/RBT2x/3N6oFu+gVV90S+XRe4UUf6AzPfn/gnWJtOZ6fTUcjY5nw2/ohPDGMUEv/cM5rGIJeT53H2c4Qr1yJsyoqSU8WaqEgk1g/gSCn0AG36RSw==</latexit> tanh <latexit sha1_base64="DyyzWJsU+/UDYnrzOZlHdxaANSc=">AAACdXichVHLSsNAFD2Nr1pfUTeCCMWquKpTFRVXghuXfRhbUClJnNZgXiRpQEN/wB9woRuFKuJnuPEHXPgJ4rKCGxfepAFRUW/IzJkz99x7Zkaxdc31GHtKCF3dPb19yf7UwODQ8Ig4OrbjWg1H5ZJq6ZZTUWSX65rJJU/zdF6xHS4bis7LytFmuF/2ueNqlrntHdt835DrplbTVNkjqiqKwZ5SS0u2KxvUzqw3q2KGZVkU6Z8gF4MM4shb4g32cAALKhowwGHCI6xDhkvfLnJgsInbR0CcQ0iL9jmaSJG2QVmcMmRij2is02o3Zk1ahzXdSK1SF51+h5RpzLJHdsva7IHdsWf2/mutIKoRejmmWelouV0dOZ0ovf2rMmj2cPip+tOzhxrWIq8aebcjJjyF2tH7J2ft0npxNphjV+yF/F+yJ3ZPJzD9V7VV4MVzpOgBct+v+yfYWczmVrJLhcXMxnL8FElMYhrzdN+r2MAW8pCor48LtHCdeBOmhBlhrpMqJGLNOL6EsPABowmQmw==</latexit> Upsampling <latexit sha1_base64="wNZ9eSoQI7ZL2wpRp6ZdgmqvoBI=">AAACfXichVHLSsNAFD2Nr1ofrboR3BRLxYWWaRUrrgQ3LuujWmxLSdJpHZomIUkLtegH+AMuXCmKiOhPuPEHXPgJ4lLBjaA3aUBU1DvMzJkz99w5M6OYmrAdxh4CUld3T29fsD80MDg0HI6MjG7ZRsNSeVY1NMPKKbLNNaHzrCMcjedMi8t1RePbSm3F3d9ucssWhr7ptExerMtVXVSEKjtElSLj7YJSie5wy5jNyOWy0KuzbrnyfikSYwnmRfQnSPogBj8yRuQCBZRhQEUDdXDocAhrkGFTyyMJBpO4ItrEWYSEt8+xjxBpG5TFKUMmtkZjlVZ5n9Vp7da0PbVKp2jULVJGEWf37JI9szt2xR7Z26+12l4N10uLZqWj5WYpfDi+8fqvqk6zg91P1Z+eHVSw6HkV5N30GPcWakff3Dt63lhaj7en2Cl7Iv8n7IHd0g305ot6vsbXjxGiD0h+f+6fYCuVSC4k5tZSseV5/yuCmMAkpum901jGKjLI0rkHOMM1bgLvUlyakRKdVCnga8bwJaT0BycCk3s=</latexit> Zero-Padding-based <latexit sha1_base64="ZQ2XrMynS7M7LG7YPD1yMVw5FSs=">AAACbnichVHLSsNAFD2Nr1pfVUEEEcVScVUmKiquBDcubWtVqFKSOLZD0yQk00Jb/AH34kJQFETEz3DjD7joJ4gboYIbF96mAVFRb5jMmTP33DlzR3dM4UnGGiGlo7OruyfcG+nrHxgcig6PbHt22TV4xrBN293VNY+bwuIZKaTJdx2XayXd5Dt6cb21v1Phridsa0tWHb5f0vKWOBSGJonKpquWLHBP1PhBLhpjCebH9E+gBiCGIDbt6A32cAAbBsoogcOCJGxCg0dfFioYHOL2USfOJST8fY4jREhbpixOGRqxRfrnaZUNWIvWrZqerzboFJOGS8ppxNkju2VN9sDu2BN7/7VW3a/R8lKlWW9ruZMbOh5Pv/2rKtEsUfhU/elZ4hArvldB3h2fad3CaOsrtdNmejUVr8+yK/ZM/i9Zg93TDazKq3Gd5KkzROgB1O/t/gm25xPqUmIhOR9bWwyeIowJzGCO+r2MNWxgExm/Yyc4x0XoRRlTJpWpdqoSCjSj+BLK3AfFpo52</latexit> Synthesized <latexit sha1_base64="s5ApCbZZx5L/zNvoq+CKUJcKDQ0=">AAACa3ichVG7SgNBFD1ZXzE+Ek0jahEMEaswiaJiFbCxzMM8IIawu050yb7Y3QRi8AcsbSxioyAifoaNP2CRTxCximBj4c1mQTSod5mdM2fuuXPmjmSqiu0w1vUJI6Nj4xP+ycDU9MxsMDQ3X7CNhiXzvGyohlWSRJuris7zjuKovGRaXNQklRel+m5/v9jklq0Y+r7TMnlFE490pabIokNUqSg2ec2wtGooyuLMjcgwSHggCi/SRugWBziEARkNaODQ4RBWIcKmr4wEGEziKmgTZxFS3H2OUwRI26AsThkisXX6H9Gq7LE6rfs1bVct0ykqDYuUEcTYE7tjPfbI7tkz+/i1Vtut0ffSolkaaLlZDZ4t5N7/VWk0Ozj+Uv3p2UEN265XhbybLtO/hTzQN08uermdbKy9yq7ZC/m/Yl32QDfQm2/yTYZnOwjQAyR+tnsYFJLxxGZ8PZOMpja8p/BjCStYo35vIYU9pJF3+3yODi59r0JYWBSWB6mCz9OE8S2E2CejUI0F</latexit> Waveform <latexit sha1_base64="xIhSSitPT2rOrGV3sdAxXYBVdbc=">AAACgHichVG7SgNBFD1Z3/GRqI1gsxgUqzgbRcVKFMQyD2MElbC7TnTIZnfZnQRisLD1ByysFETERr/Bxh+wyCeIpYKNhTebBVFR7zAzZ87cc+fMjOFawpeMNSNKR2dXd09vX7R/YHAoFh8e2fSdqmfyvOlYjrdl6D63hM3zUkiLb7ke1yuGxQtGebW1X6hxzxeOvSHrLt+t6Pu2KAlTl0QV4+ONHaOk5uq2POC+8NU1YUnuqSu6XT4qxhMsyYJQfwItBAmEkXbiV9jBHhyYqKICDhuSsAUdPrVtaGBwidtFgziPkAj2OY4QJW2Vsjhl6MSWadyn1XbI2rRu1fQDtUmnWNQ9UqqYZI/smr2wB3bDntj7r7UaQY2WlzrNRlvL3WLsZCz39q+qQrPEwafqT88SJSwGXgV5dwOmdQuzra8dnr7klrKTjSl2wZ7J/zlrsnu6gV17NS8zPHuGKH2A9v25f4LNVFKbT85mUonlufArejGOCUzTey9gGetII0/nHuMKt7hTFGVamVG0dqoSCTWj+BLK0gcJZJPW</latexit> Synthesis Filter Bank <latexit sha1_base64="SvZ0psZWIG+uwFmilZwO65BHQhk=">AAACanichVFNLwNBGH66vuur6kJ6EUXq0syWIE4SiTi2qEqQZndNa2K/sjtt0PgDbk4SPZGIiJ/h4g84+AnCjcTFwdvtJoLgnczMM8+8zzvPzOiuKXzJ2ENEaWlta+/o7Ip29/T29ccG4uu+U/EMnjcc0/E2dM3nprB5Xgpp8g3X45qlm7yg7y029gtV7vnCsdfkgcu3La1si5IwNElUIbUk9vnOZDGWZGkWxMhPoIYgiTCyTuwKW9iBAwMVWOCwIQmb0OBT24QKBpe4bdSI8wiJYJ/jCFHSViiLU4ZG7B6NZVpthqxN60ZNP1AbdIpJ3SPlCMbZPbtmL+yO3bBH9v5rrVpQo+HlgGa9qeVusf94aPXtX5VFs8Tup+pPzxIlzAVeBXl3A6ZxC6Oprx6evqzOr4zXJtgFeyL/5+yB3dIN7OqrcZnjK3VE6QPU78/9E6xn0upMeiqXSS5Mh1/RiQRGkaL3nsUClpFFPnB3gjPUI89KXBlWEs1UJRJqBvEllLEPbUOL9Q==</latexit> (Fixed) <latexit sha1_base64="HWXqYG4k2bKbVOswmC5CBPTuGt8=">AAACcHichVHLSgMxFD0dX7U+WnUjuLBaFHFR0lpUXBXcuOzDqqBFZsbYhk5nxpm00BZ/wB9w4UYFEfEz3PgDLvoJ4k4FNy68nQ6IinpDkpOTe25OEs02hCsZaweUnt6+/oHgYGhoeGQ0HBkb33KtmqPzgm4ZlrOjqS43hMkLUkiD79gOV6uawbe1ynpnf7vOHVdY5qZs2LxYVUumOBS6KokqpqL5hinL3BVNfrAfibE48yL6EyR8EIMfGStyjT0cwIKOGqrgMCEJG1DhUttFAgw2cUW0iHMICW+f4xgh0tYoi1OGSmyFxhKtdn3WpHWnpuupdTrFoO6QMoo59sBu2Au7Z7fskb3/Wqvl1eh4adCsdbXc3g+fTObf/lVVaZYof6r+9CxxiFXPqyDvtsd0bqF39fXm6Ut+LTfXmmeX7In8X7A2u6MbmPVX/SrLc2cI0Qckvj/3T7CVjCeW40vZZCyd8r8iiCnMYoHeewVpbCCDAp17hFOc4yLwrEwq08pMN1UJ+JoJfAll8QO8b47e</latexit> 4 Synthesized <latexit sha1_base64="ribSY8FjUsAXKyN8FxPzX+UhDdA=">AAACdnichVG7SgNBFD1ZXzE+kmgjCBIMUatwo6JiFbCxjMY8QCXsrhNd3Be7m0gM/oA/YCEWChrEz7DxByz8BLFU0MLCm82CqKh3mJkzZ+65c2ZGsXXN9YgeQlJXd09vX7g/MjA4NByNxUeKrlVzVFFQLd1yyorsCl0zRcHTPF2UbUfIhqKLkrK/0t4v1YXjapa54TVssW3Iu6ZW1VTZY6oSi+driiKbO4mSXBdVyzHcSixJafIj8RNkApBEEDkr1sIWdmBBRQ0GBEx4jHXIcLltIgOCzdw2msw5jDR/X+AIEdbWOEtwhszsPo+7vNoMWJPX7Zqur1b5FJ27w8oEUnRP1/RMd3RDj/T+a62mX6PtpcGz0tEKuxI9Hsu//qsyePaw96n607OHKpZ8rxp7t32mfQu1o68fnjznl9dTzSm6oCf2f04PdMs3MOsv6uWaWD9FhD8g8/25f4LibDqzkJ5bm01m54OvCGMck5jh915EFqvIocDnHuAMV2iF3qQJKSVNd1KlUKAZxZeQ6ANH6pDi</latexit> Subband Waveforms <latexit sha1_base64="FLUJZEOdq5RME9XU3pHl9q//TQ0=">AAACe3ichVHLSgMxFD0d3/XRqiCCm2KpiEhJ6xNXigvdKK3aKrSlzIxpHZzODDNpQas/4A+4cKUgIvoXbvwBF/0EcVnBjYK30wHRot6Q5OTknpuTRLF0zRGM1XxSW3tHZ1d3j7+3r38gEBwcSjtm2VZ5SjV1095TZIfrmsFTQhM637NsLpcUne8qh6uN/d0Ktx3NNHbEkcVzJbloaAVNlQVR+eBINasUQhtcX1vZDK1xg9uyMO3TfDDMosyNUCuIeSAMLxJm8AZZ7MOEijJK4DAgCOuQ4VDLIAYGi7gcqsTZhDR3n+MUftKWKYtThkzsIY1FWmU81qB1o6bjqlU6RadukzKECHtit6zOHtkde2bvv9aqujUaXo5oVppabuUDZ6Pbb/+qSjQLHHyp/vQsUMCi61Uj75bLNG6hNvWV4/P69tJWpDrBrtgL+b9kNfZANzAqr+p1km9dwE8fEPv53K0gHY/G5qMzyXh4edb7im6MYRyT9N4LWMY6EkjRuSe4wh3ufR9SWJqSppupks/TDONbSHOf3HOScg==</latexit> MelGAN Generator <latexit sha1_base64="dVWEVtnZAyvBtUuy105S2N1KkVU=">AAACbHichVHLSgMxFD0d3/VVHwuhCMVScVVSFRVXBUFcuGhta5VaZGZMNTgvJtOCFn/ArQsX6kJBRPwMN/6ACz9BBDcKblx4Ox0QFfWGJCcn99ycJJpjCOkx9hBSWlrb2js6u8LdPb19/ZGBwVVpV12dF3TbsN01TZXcEBYveMIz+JrjctXUDF7Udhca+8Uad6Wwrby35/CyqW5boiJ01SNqPZdfzMeWbSk3I3GWZH7EfoJUAOIIImNHrrCBLdjQUYUJDgseYQMqJLUSUmBwiCujTpxLSPj7HAcIk7ZKWZwyVGJ3adymVSlgLVo3akpfrdMpBnWXlDEk2D27Zi/sjt2wR/b+a626X6PhZY9mranlzmb/4Uju7V+VSbOHnU/Vn549VDDnexXk3fGZxi30pr62f/ySm19J1MfZBXsi/+fsgd3SDazaq36Z5SsnCNMHpL4/90+wOplMzSSnspPx9HTwFZ2IYgwT9N6zSGMJGRToXBNHOMVZ6FkZVqLKaDNVCQWaIXwJZfwDPpSMyg==</latexit> STFT Loss <latexit sha1_base64="AOiF5VNDxrumn6UBOsgP3Nnx9H4=">AAACjHicSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQuoayRqKviW5pRk6iYl5qUo+KbmuDv6Kbin5qUWJZbkFyn4pZaU5xdlxwsoG+gZgIECJsMQylBmgIKAfIHlDDEMKQz5DMkMpQy5DKkMeQwlQHYOQyJDMRBGMxgyGDAUAMViGaqBYkVAViZYPpWhloELqLcUqCoVqCIRKJoNJNOBvGioaB6QDzKzGKw7GWhLDhAXAXUqMKgaXDVYafDZ4ITBaoOXBn9wmlUNNgPklkognQTRm1oQz98lEfydoK5cIF3CkIHQhdfNJQxpDBZgt2YC3V4AFgH5Ihmiv6xq+udgqyDVajWDRQavge5faHDT4DDQB3llX5KXBqYGzWbgAkaAIXpwYzLCjPQMzfSMA42UHaygUcHBIM2gxKABDG9zBgcGD4YAhlCgvb0Mmxn2MOxl4mMyYbJmsoUoZWKE6hFmQAFMbgD0OJew</latexit> (a) Multi-band MelGAN Generator Network <latexit sha1_base64="bjbCykvuOkou9Qq6vXkWketNYX0=">AAACcHichVHLSgMxFD0d3/XRqhvBhdVSERclo6LiSnDj0lcfUEuZGdManGbGmWmhFn/AH+jCjQoi4me48Qdc+AnizgpuXHg7HRAt6g1JTk7uuTlJdNsUrsfYU0jp6u7p7esfCA8ODY9EoqNjadeqOAZPGZZpOVldc7kpJE95wjN51na4VtZNntGPNlr7mSp3XGHJPa9m83xZK0lRFIbmEZXfczQhhSzFLGnWCtE4SzI/Yp1ADUAcQWxZ0Rvs4wAWDFRQBoeER9iEBpdaDioYbOLyqBPnEBL+PscpwqStUBanDI3YIxpLtMoFrKR1q6brqw06xaTukDKGBHtkt6zJHtgde2Yfv9aq+zVaXmo0620ttwuRs4nd939VZZo9HH6p/vTsoYhV36sg77bPtG5htPXVk0Zzd20nUZ9lV+yF/F+yJ3ZPN5DVN+N6m++cI0wfoP587k6QXkiqy8nF7YX4+lLwFf2YxAzm6L1XsI5NbCFF5x6jgQtchl6VCWVKmW6nKqFAM45vocx/AiAWjw4=</latexit> Training only <latexit sha1_base64="r/q5gHUWGca+aDj6QK7We9+Xt3Y=">AAACl3ichVHBThQxGP4YVHAVWfGC8TJxg8GDm+6SIOEixES4QHbBBRIkm5nhB5rtTied7hLc+AK+gCScIDGG8A5ePMALcOARCEdMvHjwn9lJCBD1b9p+/fp/f7+2fqRkbIU463F679y919d/P/fg4cCjwfzjoaVYt0xAtUArbVZ8LyYlQ6pZaRWtRIa8pq9o2W+8TfaX22RiqcP3dieitaa3GcoNGXiWqXq+POq/dCtGRzqmdXeupax8FdukgjtHamZ63p2hkIxntXHnyW5r06jnC6Io0nBvg1IGCsiiovPf8AHr0AjQQhOEEJaxgoeY2ypKEIiYW0OHOcNIpvuET8ixtsVZxBkesw0eN3m1mrEhr5OacaoO+BTF3bDSxYg4FYfiUpyII3Eufv+1VietkXjZ4dnvaimqD34eXvz1X1WTZ4utK9U/PVtsYCL1Ktl7lDLJLYKuvv3xy+Xi5MJI54U4EBfsf1+ciR98g7D9M/hapYU95PgDSjef+zZYKhdL48WxarkwNZl9RT+e4TlG+b1fYwqzqKDG5+7iO45x4jx13jjvnNluqtOTaZ7gWjjVPxRZnII=</latexit> (b) Proposed Multi-stream MelGAN Generator Network <latexit sha1_base64="5bv/Fn8RI0HR6kR253f7wpLXIZY=">AAACdHichVHLSsNAFD2N7/po1I2gi2KouLFMq6i4Ety4EeqjWqhSkjjW0MmDZFrQ4g/4Ay5cKRYRP8ONP+DCTxCXFd248DYNiIp6w2TOnLnnzpm5hiesQDL2GFM6Oru6e3r74v0Dg0MJdXhkO3Crvsnzpitcv2DoAReWw/PSkoIXPJ/rtiH4jlFZae3v1LgfWK6zJY88vmfrZcc6sExdElVSE2tczAQeN6Xvln3dLqkaS7Mwkj9BJgIaosi56jV2sQ8XJqqwweFAEhbQEdBXRAYMHnF7qBPnE7LCfY4TxElbpSxOGTqxFfqXaVWMWIfWrZpBqDbpFEHDJ2USKfbAbliT3bNb9sTef61VD2u0vBzRbLS13CslTsc23/5V2TRLHH6q/vQscYDF0KtF3r2Qad3CbOtrx2fNzaWNVH2KXbJn8n/BHtkd3cCpvZiNdb5xjjg1IPP9uX+C7Ww6M5+eXc9qy3NRK3oxjklM03svYBmryCEf9uQcV2jEXpUJRVNS7VQlFmlG8SWU9AejXJAn</latexit> Mel-spectrogram <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="DyyzWJsU+/UDYnrzOZlHdxaANSc=">AAACdXichVHLSsNAFD2Nr1pfUTeCCMWquKpTFRVXghuXfRhbUClJnNZgXiRpQEN/wB9woRuFKuJnuPEHXPgJ4rKCGxfepAFRUW/IzJkz99x7Zkaxdc31GHtKCF3dPb19yf7UwODQ8Ig4OrbjWg1H5ZJq6ZZTUWSX65rJJU/zdF6xHS4bis7LytFmuF/2ueNqlrntHdt835DrplbTVNkjqiqKwZ5SS0u2KxvUzqw3q2KGZVkU6Z8gF4MM4shb4g32cAALKhowwGHCI6xDhkvfLnJgsInbR0CcQ0iL9jmaSJG2QVmcMmRij2is02o3Zk1ahzXdSK1SF51+h5RpzLJHdsva7IHdsWf2/mutIKoRejmmWelouV0dOZ0ovf2rMmj2cPip+tOzhxrWIq8aebcjJjyF2tH7J2ft0npxNphjV+yF/F+yJ3ZPJzD9V7VV4MVzpOgBct+v+yfYWczmVrJLhcXMxnL8FElMYhrzdN+r2MAW8pCor48LtHCdeBOmhBlhrpMqJGLNOL6EsPABowmQmw==</latexit> Upsampling <latexit sha1_base64="Slc65VJzzRYHtCtTplG0z6/rHdk=">AAACcXichVFNSwJBGH7cvsw+tLoUXSQpgkBGi4pOQpeOfqQJarG7jTa47i67q2DiH+gPFHRSiIh+Rpf+QAd/QnQ06NKh13UhKqp3mJlnnnmfd56ZUUxN2A5jPZ80Mjo2PuGfDExNz8wGQ3PzOduoWyrPqoZmWHlFtrkmdJ51hKPxvGlxuaZo/Eip7g/2jxrcsoWhHzpNk5dqckUXZaHKDlHHraJSDqe5LU7rstY+CUVYlLkR/gliHojAi6QRukURpzCgoo4aOHQ4hDXIsKkVEAODSVwJLeIsQsLd52gjQNo6ZXHKkImt0lihVcFjdVoPatquWqVTNOoWKcNYZU/sjvXZI7tnz+z911ott8bAS5NmZajl5knwYjHz9q+qRrODs0/Vn54dlLHrehXk3XSZwS3Uob5xftnP7KVXW2usy17If4f12APdQG+8qjcpnr5GgD4g9v25f4JcPBrbjm6m4pHElvcVfixjBev03jtI4ABJZOlcC1fooOvrS0tSWFoZpko+T7OALyFtfAD3Uo9v</latexit> Residual <latexit sha1_base64="X6pW9DuNIJuzqc/uIQxMKdiBnNA=">AAACbnichVHLSsNAFD2Nr1ofrQoiiFgsFVdlWkXFVdGNyz6sCrWUJE5raF4kaaGW/oB7cSEoCiLiZ7jxB1z0E8SNUMGNC2/TgGhRb5jMmTP33DlzRzJVxXYYa/mEvv6BwSH/cGBkdGw8GJqY3LWNqiXznGyohrUviTZXFZ3nHMVR+b5pcVGTVL4nVbY6+3s1btmKoe84dZMXNLGsKyVFFh2i8o0DqRTeVA250iyGIizG3Aj3grgHIvAiZYRucYBDGJBRhQYOHQ5hFSJs+vKIg8EkroAGcRYhxd3naCJA2iplccoQia3Qv0yrvMfqtO7UtF21TKeoNCxShhFlT+yOtdkju2fP7OPXWg23RsdLnWapq+VmMXgyk33/V6XR7ODoS/WnZwclrLteFfJuukznFnJXXzs+a2c3MtHGIrtmL+T/irXYA91Ar73JN2meOUeAHiD+s929YDcRi6/GltOJSHLFewo/ZrGAJer3GpLYRgo5t2OnuMCl71WYFuaE+W6q4PM0U/gWwtIn3M+OAw==</latexit> Block <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="4W8kVIAFDYKqxJRx+bHFCFn2NAg=">AAACdnichVHLSsNAFD2N7/po1Y0gSLFUXZVbLSquBDcutVoVrJQkTjWYJiGZ1kfoD/gDLsSFghbxM9z4Ay78BHGpoAsX3qYBUVHvMDNnztxz58yM5piGJ4keIkpLa1t7R2dXtLunty8W7x9Y8+yKq4u8bpu2u6GpnjANS+SlIU2x4bhCLWumWNf2Fhr761XheoZtrcpDR2yV1R3LKBm6KpkqxvsLUhxI3y9opYRUrd1arRhPUpqCSPwEmRAkEcaSHa+jgG3Y0FFBGQIWJGMTKjxum8iA4DC3BZ85l5ER7AvUEGVthbMEZ6jM7vG4w6vNkLV43ajpBWqdTzG5u6xMIEX3dE3PdEc39Ejvv9bygxoNL4c8a02tcIqx46GV139VZZ4ldj9Vf3qWKGE28GqwdydgGrfQm/rq0cnzylwu5Y/RBT2x/3N6oFu+gVV90S+XRe4UUf6AzPfn/gnWJtOZ6fTUcjY5nw2/ohPDGMUEv/cM5rGIJeT53H2c4Qr1yJsyoqSU8WaqEgk1g/gSCn0AG36RSw==</latexit> tanh <latexit sha1_base64="DyyzWJsU+/UDYnrzOZlHdxaANSc=">AAACdXichVHLSsNAFD2Nr1pfUTeCCMWquKpTFRVXghuXfRhbUClJnNZgXiRpQEN/wB9woRuFKuJnuPEHXPgJ4rKCGxfepAFRUW/IzJkz99x7Zkaxdc31GHtKCF3dPb19yf7UwODQ8Ig4OrbjWg1H5ZJq6ZZTUWSX65rJJU/zdF6xHS4bis7LytFmuF/2ueNqlrntHdt835DrplbTVNkjqiqKwZ5SS0u2KxvUzqw3q2KGZVkU6Z8gF4MM4shb4g32cAALKhowwGHCI6xDhkvfLnJgsInbR0CcQ0iL9jmaSJG2QVmcMmRij2is02o3Zk1ahzXdSK1SF51+h5RpzLJHdsva7IHdsWf2/mutIKoRejmmWelouV0dOZ0ovf2rMmj2cPip+tOzhxrWIq8aebcjJjyF2tH7J2ft0npxNphjV+yF/F+yJ3ZPJzD9V7VV4MVzpOgBct+v+yfYWczmVrJLhcXMxnL8FElMYhrzdN+r2MAW8pCor48LtHCdeBOmhBlhrpMqJGLNOL6EsPABowmQmw==</latexit> Upsampling <latexit sha1_base64="wNZ9eSoQI7ZL2wpRp6ZdgmqvoBI=">AAACfXichVHLSsNAFD2Nr1ofrboR3BRLxYWWaRUrrgQ3LuujWmxLSdJpHZomIUkLtegH+AMuXCmKiOhPuPEHXPgJ4lLBjaA3aUBU1DvMzJkz99w5M6OYmrAdxh4CUld3T29fsD80MDg0HI6MjG7ZRsNSeVY1NMPKKbLNNaHzrCMcjedMi8t1RePbSm3F3d9ucssWhr7ptExerMtVXVSEKjtElSLj7YJSie5wy5jNyOWy0KuzbrnyfikSYwnmRfQnSPogBj8yRuQCBZRhQEUDdXDocAhrkGFTyyMJBpO4ItrEWYSEt8+xjxBpG5TFKUMmtkZjlVZ5n9Vp7da0PbVKp2jULVJGEWf37JI9szt2xR7Z26+12l4N10uLZqWj5WYpfDi+8fqvqk6zg91P1Z+eHVSw6HkV5N30GPcWakff3Dt63lhaj7en2Cl7Iv8n7IHd0g305ot6vsbXjxGiD0h+f+6fYCuVSC4k5tZSseV5/yuCmMAkpum901jGKjLI0rkHOMM1bgLvUlyakRKdVCnga8bwJaT0BycCk3s=</latexit> Zero-Padding-based <latexit sha1_base64="ZQ2XrMynS7M7LG7YPD1yMVw5FSs=">AAACbnichVHLSsNAFD2Nr1pfVUEEEcVScVUmKiquBDcubWtVqFKSOLZD0yQk00Jb/AH34kJQFETEz3DjD7joJ4gboYIbF96mAVFRb5jMmTP33DlzR3dM4UnGGiGlo7OruyfcG+nrHxgcig6PbHt22TV4xrBN293VNY+bwuIZKaTJdx2XayXd5Dt6cb21v1Phridsa0tWHb5f0vKWOBSGJonKpquWLHBP1PhBLhpjCebH9E+gBiCGIDbt6A32cAAbBsoogcOCJGxCg0dfFioYHOL2USfOJST8fY4jREhbpixOGRqxRfrnaZUNWIvWrZqerzboFJOGS8ppxNkju2VN9sDu2BN7/7VW3a/R8lKlWW9ruZMbOh5Pv/2rKtEsUfhU/elZ4hArvldB3h2fad3CaOsrtdNmejUVr8+yK/ZM/i9Zg93TDazKq3Gd5KkzROgB1O/t/gm25xPqUmIhOR9bWwyeIowJzGCO+r2MNWxgExm/Yyc4x0XoRRlTJpWpdqoSCjSj+BLK3AfFpo52</latexit> Synthesized <latexit sha1_base64="s5ApCbZZx5L/zNvoq+CKUJcKDQ0=">AAACa3ichVG7SgNBFD1ZXzE+Ek0jahEMEaswiaJiFbCxzMM8IIawu050yb7Y3QRi8AcsbSxioyAifoaNP2CRTxCximBj4c1mQTSod5mdM2fuuXPmjmSqiu0w1vUJI6Nj4xP+ycDU9MxsMDQ3X7CNhiXzvGyohlWSRJuris7zjuKovGRaXNQklRel+m5/v9jklq0Y+r7TMnlFE490pabIokNUqSg2ec2wtGooyuLMjcgwSHggCi/SRugWBziEARkNaODQ4RBWIcKmr4wEGEziKmgTZxFS3H2OUwRI26AsThkisXX6H9Gq7LE6rfs1bVct0ykqDYuUEcTYE7tjPfbI7tkz+/i1Vtut0ffSolkaaLlZDZ4t5N7/VWk0Ozj+Uv3p2UEN265XhbybLtO/hTzQN08uermdbKy9yq7ZC/m/Yl32QDfQm2/yTYZnOwjQAyR+tnsYFJLxxGZ8PZOMpja8p/BjCStYo35vIYU9pJF3+3yODi59r0JYWBSWB6mCz9OE8S2E2CejUI0F</latexit> Waveform <latexit sha1_base64="FLUJZEOdq5RME9XU3pHl9q//TQ0=">AAACe3ichVHLSgMxFD0d3/XRqiCCm2KpiEhJ6xNXigvdKK3aKrSlzIxpHZzODDNpQas/4A+4cKUgIvoXbvwBF/0EcVnBjYK30wHRot6Q5OTknpuTRLF0zRGM1XxSW3tHZ1d3j7+3r38gEBwcSjtm2VZ5SjV1095TZIfrmsFTQhM637NsLpcUne8qh6uN/d0Ktx3NNHbEkcVzJbloaAVNlQVR+eBINasUQhtcX1vZDK1xg9uyMO3TfDDMosyNUCuIeSAMLxJm8AZZ7MOEijJK4DAgCOuQ4VDLIAYGi7gcqsTZhDR3n+MUftKWKYtThkzsIY1FWmU81qB1o6bjqlU6RadukzKECHtit6zOHtkde2bvv9aqujUaXo5oVppabuUDZ6Pbb/+qSjQLHHyp/vQsUMCi61Uj75bLNG6hNvWV4/P69tJWpDrBrtgL+b9kNfZANzAqr+p1km9dwE8fEPv53K0gHY/G5qMzyXh4edb7im6MYRyT9N4LWMY6EkjRuSe4wh3ufR9SWJqSppupks/TDONbSHOf3HOScg==</latexit> MelGAN Generator <latexit sha1_base64="3S73na9z9RiLMTbUigJC38BMVGs=">AAACe3ichVHNSsNAEP4a/+tfVRDBS7AoIqVMarXqSfDiUVurgkpJ4lZD0yQkaaFWX8AX8OBJQUT0Lbz4Ah58BPGo4EXBaRoRD9VZdnfm2/lmv93RHNPwfKKniNTW3tHZ1d0T7e3rHxiMDQ1venbF1UVet03b3dZUT5iGJfK+4Zti23GFWtZMsaWVVhrnW1XheoZtbfg1R+yV1QPLKBq66jNUiI2WhGsJc0men03I+qFqBYFSiMUpuUiLaSKZkhQYO2lKZVKKrIRIHKGt2bFr7GIfNnRUUIaABZ99Eyo8HjtQQHAY20OdMZc9IzgXOEGUuRXOEpyhMlri9YCjnRC1OG7U9AK2zreYPF1mypikR7qhV3qgW3qmj5a16kGNhpYa71qTK5zC4OlY7v1fVpl3H4c/rD81+yhiIdBqsHYnQBqv0Jv86tHZa24pO1mfokt6Yf0X9ET3/AKr+qZfrYvsOaLcgO9flls7m6mkMp+cXU/Fl9NhK7oxjglM839nsIxVrCHP9x7jEre4i3xKcWlGSjRTpUjIGcEvk+a+AB40kZU=</latexit> kernel: 63, channel: 1 <latexit sha1_base64="/dV5MgkluHnru+XweyIbtPS1sWI=">AAACenichVHNSsNAEP4a/+tfVQTBS7AoilCntbTqSdCDR/+qgkpJ4rYupklI0ooGX8AX8OBJQUR9DC++gAcfQTwqePHgNI2IB3WW3Zn9dr6Zb3d1x5SeT/QUU5qaW1rb2jvinV3dPb2Jvv4Nz666higYtmm7W7rmCVNaouBL3xRbjiu0im6KTf1goX6+WROuJ21r3T9yxG5FK1uyJA3NZ6iYGAx29JK6YFu19OKJejhlq7rUvGIiSanZXJ6m8yqlKDQOsplcNjerpiMkiciW7cQ1drAHGwaqqEDAgs+xCQ0ej22kQXAY20XAmMuRDM8FThBnbpWzBGdojB7wWubddoRavK/X9EK2wV1Mni4zVYzSI93QKz3QHT3Tx6+1grBGXcsRe73BFU6x93Ro7f1fVoW9j/1v1p+afZQwE2qVrN0JkfotjAa/dnz2uja3OhqM0SW9sP4LeqJ7voFVezOuVsTqOeL8AV+vrP4ebGRS6VxqeiWTnM9GX9GOYYxgnN87j3ksYRkF7hvgAre4i30oI8qEMtlIVWIRZwA/TMl+ArIDkes=</latexit> Conv1D w/o bias <latexit sha1_base64="MmQB8g6zhVnWK+g8WgJI+qHPHxg=">AAACcHichVHLLgRBFD3T3uMxg43EQjMhIjG5MyZeKwkLS69BwkS6W6Gip7t110zCxA/4AQsbJCLiM2z8gIVPEDskNhbu9LSIBW6l6t46dc+9p6pMz5aBInqMaXX1DY1NzS3x1rb2jkSys2s1cEu+JfKWa7v+umkEwpaOyCupbLHu+cIomrZYM/dnq+drZeEH0nVW1KEnCkVj15E70jIUQ4WcPmcoY3TOl2XhbCVTlJ6iqRyRTmkKjYMcZSeyGT0TISlEtuAmr7GJbbiwUEIRAg4UxzYMBDw2kAHBY6yACmM+RzI8FzhGnLklzhKcYTC6z+su7zYi1OF9tWYQsi3uYvP0maljkB7ohl7pnm7piT5+rVUJa1S1HLI3a1zhbSVOepbf/2UV2SvsfbP+1Kywg8lQq2TtXohUb2HV+OWj09fl6aXByhBd0jPrv6BHuuMbOOU362pRLJ0hzh/w9cr678FqNp0ZT48tZlMzuegrmtGLAQzze09gBvNYQJ77HuAU57iIvWg9Wp/WX0vVYhGnGz9MG/kE7EKOeQ==</latexit> 4 Data-Driven <latexit sha1_base64="y6+bd9VAg7vhkUkSecbsVzHCHZY=">AAACeXichVHLSsNAFD2N7/qqj4XgJloUcVFua/G1EnTh0qq1gkpJ4lSDSSYkaUGLP+APuHCjgoj6GW78ARf9BHGp4EIX3qYRcaHeYebeOXPPvWdmdNcy/YCoFlOamlta29o74p1d3T29ib7+DV+WPUPkDWlJb1PXfGGZjsgHZmCJTdcTmq1boqAfLNbPCxXh+aZ01oNDV+zY2p5jlkxDCxgqJgaXhCFtV/piVy1oFVGSnu0XE0lKzdFclkilFIXGQZYyM5m0mo6QJCJbkYlrbGMXEgbKsCHgIODYggafxxbSILiM7aDKmMeRGZ4LHCPO3DJnCc7QGD3gdY93WxHq8L5e0w/ZBnexeHrMVDFGj3RDL/RAd/REH7/WqoY16loO2esNrnCLvSdDa2//smz2Afa/WX9qDlDCbKjVZO1uiNRvYTT4laPTl7X51bHqOF3SM+u/oBrd8w2cyqtxlROrZ4jzB3y9svp7sJFJpadTU7lMciEbfUU7hjGKCX7vGSxgGSvIc98jnOMGt7F3ZUSZUCYbqUos4gzghylTn6CVkmo=</latexit> Decomposed Waveforms 8
  9. Introducing trainable synthesis fi lter to Multi-band HiFi-GAN Final fourfold

    upsampling is realized by zero-padding-based upsampling 
 with a trainable CNN layer Four-stream waveforms decomposed 
 in a data-driven manner Without multi-band constraint Same discriminators as HiFi-GAN Successfully trained without subband STFT loss Proposed Multi-stream HiFi-GAN 9 <latexit sha1_base64="5bv/Fn8RI0HR6kR253f7wpLXIZY=">AAACdHichVHLSsNAFD2N7/po1I2gi2KouLFMq6i4Ety4EeqjWqhSkjjW0MmDZFrQ4g/4Ay5cKRYRP8ONP+DCTxCXFd248DYNiIp6w2TOnLnnzpm5hiesQDL2GFM6Oru6e3r74v0Dg0MJdXhkO3Crvsnzpitcv2DoAReWw/PSkoIXPJ/rtiH4jlFZae3v1LgfWK6zJY88vmfrZcc6sExdElVSE2tczAQeN6Xvln3dLqkaS7Mwkj9BJgIaosi56jV2sQ8XJqqwweFAEhbQEdBXRAYMHnF7qBPnE7LCfY4TxElbpSxOGTqxFfqXaVWMWIfWrZpBqDbpFEHDJ2USKfbAbliT3bNb9sTef61VD2u0vBzRbLS13CslTsc23/5V2TRLHH6q/vQscYDF0KtF3r2Qad3CbOtrx2fNzaWNVH2KXbJn8n/BHtkd3cCpvZiNdb5xjjg1IPP9uX+C7Ww6M5+eXc9qy3NRK3oxjklM03svYBmryCEf9uQcV2jEXpUJRVNS7VQlFmlG8SWU9AejXJAn</latexit> Mel-spectrogram <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="W5aXXoObO7pbNXY1fkTBIq6f4go=">AAACfHichVHLSsNAFD2Nr1ofrbpQcFOsFUEtk6pVuiq4cemrVailJHHahqZJSNJCLf6AP+DClYqIqF/hxh9w4SeIywpuRLxNA6JFvcPMnDlzz50zM7KpqbbD2JNP6Oru6e3z9wcGBoeGg6GR0YxtVC2FpxVDM6w9WbK5puo87aiOxvdMi0sVWeO7cnmttb9b45atGvqOUzd5riIVdbWgKpJDVD40XuaWzrVkeGU+rJQk3cXLYjwfirAYcyPcCUQPRODFhhG6wj4OYEBBFRVw6HAIa5BgU8tCBINJXA4N4ixCqrvPcYQAaauUxSlDIrZMY5FWWY/Vad2qabtqhU7RqFukDCPKHtk1a7IHdsOe2fuvtRpujZaXOs1yW8vNfPB4YvvtX1WFZgelL9Wfnh0UsOp6Vcm76TKtWyhtfe3wpLmd3Io2Ztg5eyH/Z+yJ3dMN9NqrcrnJt04RoA8Qfz53J8jEY2IitrgZj6SWvK/wYxJTmKX3XkEK69hA2j33Are4830I08KcsNBOFXyeZgzfQkh8Amx5ka4=</latexit> kernel: 7, channel: 512 <latexit sha1_base64="k8bMMz392/OeCXGAjAEN/0B0y5A=">AAACdXichVG7SgNBFD1ZXzG+Vm0EEYJRsYqzKipWARsLC40mChrC7jqJS/bF7iQQQ37AH7DQRiGK+Bk2/oCFnyCWCmksvNksiAb1DjNz5sw9d87MaK5p+IKx54jU1d3T2xftjw0MDg2PyKNjWd8pezrP6I7peAea6nPTsHlGGMLkB67HVUsz+b5W2mjt71e45xuOvSeqLs9ZatE2CoauCqLyslw70grxLa6WqvE038rU83KCJVkQ8U6ghCCBMLYd+RZHOIYDHWVY4LAhCJtQ4VM7hAIGl7gcasR5hIxgn6OOGGnLlMUpQyW2RGORVocha9O6VdMP1DqdYlL3SBnHLHtid+yNPbJ79sI+fq1VC2q0vFRp1tpa7uZHziZ2m/+qLJoFTr5Uf3oWKGAt8GqQdzdgWrfQ2/rK6fnb7np6tjbHrtkr+b9iz+yBbmBX3vXGDk9fIEYfoPx87k6QXUwqK8mlneVEajn8iigmMY15eu9VpLCJbWTo3Aou0cBNpClNSTPSXDtVioSacXwLaeETPIGP6w==</latexit> LeakyReLU <latexit sha1_base64="4W8kVIAFDYKqxJRx+bHFCFn2NAg=">AAACdnichVHLSsNAFD2N7/po1Y0gSLFUXZVbLSquBDcutVoVrJQkTjWYJiGZ1kfoD/gDLsSFghbxM9z4Ay78BHGpoAsX3qYBUVHvMDNnztxz58yM5piGJ4keIkpLa1t7R2dXtLunty8W7x9Y8+yKq4u8bpu2u6GpnjANS+SlIU2x4bhCLWumWNf2Fhr761XheoZtrcpDR2yV1R3LKBm6KpkqxvsLUhxI3y9opYRUrd1arRhPUpqCSPwEmRAkEcaSHa+jgG3Y0FFBGQIWJGMTKjxum8iA4DC3BZ85l5ER7AvUEGVthbMEZ6jM7vG4w6vNkLV43ajpBWqdTzG5u6xMIEX3dE3PdEc39Ejvv9bygxoNL4c8a02tcIqx46GV139VZZ4ldj9Vf3qWKGE28GqwdydgGrfQm/rq0cnzylwu5Y/RBT2x/3N6oFu+gVV90S+XRe4UUf6AzPfn/gnWJtOZ6fTUcjY5nw2/ohPDGMUEv/cM5rGIJeT53H2c4Qr1yJsyoqSU8WaqEgk1g/gSCn0AG36RSw==</latexit> tanh <latexit sha1_base64="DyyzWJsU+/UDYnrzOZlHdxaANSc=">AAACdXichVHLSsNAFD2Nr1pfUTeCCMWquKpTFRVXghuXfRhbUClJnNZgXiRpQEN/wB9woRuFKuJnuPEHXPgJ4rKCGxfepAFRUW/IzJkz99x7Zkaxdc31GHtKCF3dPb19yf7UwODQ8Ig4OrbjWg1H5ZJq6ZZTUWSX65rJJU/zdF6xHS4bis7LytFmuF/2ueNqlrntHdt835DrplbTVNkjqiqKwZ5SS0u2KxvUzqw3q2KGZVkU6Z8gF4MM4shb4g32cAALKhowwGHCI6xDhkvfLnJgsInbR0CcQ0iL9jmaSJG2QVmcMmRij2is02o3Zk1ahzXdSK1SF51+h5RpzLJHdsva7IHdsWf2/mutIKoRejmmWelouV0dOZ0ovf2rMmj2cPip+tOzhxrWIq8aebcjJjyF2tH7J2ft0npxNphjV+yF/F+yJ3ZPJzD9V7VV4MVzpOgBct+v+yfYWczmVrJLhcXMxnL8FElMYhrzdN+r2MAW8pCor48LtHCdeBOmhBlhrpMqJGLNOL6EsPABowmQmw==</latexit> Upsampling <latexit sha1_base64="wNZ9eSoQI7ZL2wpRp6ZdgmqvoBI=">AAACfXichVHLSsNAFD2Nr1ofrboR3BRLxYWWaRUrrgQ3LuujWmxLSdJpHZomIUkLtegH+AMuXCmKiOhPuPEHXPgJ4lLBjaA3aUBU1DvMzJkz99w5M6OYmrAdxh4CUld3T29fsD80MDg0HI6MjG7ZRsNSeVY1NMPKKbLNNaHzrCMcjedMi8t1RePbSm3F3d9ucssWhr7ptExerMtVXVSEKjtElSLj7YJSie5wy5jNyOWy0KuzbrnyfikSYwnmRfQnSPogBj8yRuQCBZRhQEUDdXDocAhrkGFTyyMJBpO4ItrEWYSEt8+xjxBpG5TFKUMmtkZjlVZ5n9Vp7da0PbVKp2jULVJGEWf37JI9szt2xR7Z26+12l4N10uLZqWj5WYpfDi+8fqvqk6zg91P1Z+eHVSw6HkV5N30GPcWakff3Dt63lhaj7en2Cl7Iv8n7IHd0g305ot6vsbXjxGiD0h+f+6fYCuVSC4k5tZSseV5/yuCmMAkpum901jGKjLI0rkHOMM1bgLvUlyakRKdVCnga8bwJaT0BycCk3s=</latexit> Zero-Padding-based <latexit sha1_base64="3S73na9z9RiLMTbUigJC38BMVGs=">AAACe3ichVHNSsNAEP4a/+tfVRDBS7AoIqVMarXqSfDiUVurgkpJ4lZD0yQkaaFWX8AX8OBJQUT0Lbz4Ah58BPGo4EXBaRoRD9VZdnfm2/lmv93RHNPwfKKniNTW3tHZ1d0T7e3rHxiMDQ1venbF1UVet03b3dZUT5iGJfK+4Zti23GFWtZMsaWVVhrnW1XheoZtbfg1R+yV1QPLKBq66jNUiI2WhGsJc0men03I+qFqBYFSiMUpuUiLaSKZkhQYO2lKZVKKrIRIHKGt2bFr7GIfNnRUUIaABZ99Eyo8HjtQQHAY20OdMZc9IzgXOEGUuRXOEpyhMlri9YCjnRC1OG7U9AK2zreYPF1mypikR7qhV3qgW3qmj5a16kGNhpYa71qTK5zC4OlY7v1fVpl3H4c/rD81+yhiIdBqsHYnQBqv0Jv86tHZa24pO1mfokt6Yf0X9ET3/AKr+qZfrYvsOaLcgO9flls7m6mkMp+cXU/Fl9NhK7oxjglM839nsIxVrCHP9x7jEre4i3xKcWlGSjRTpUjIGcEvk+a+AB40kZU=</latexit> kernel: 63, channel: 1 <latexit sha1_base64="CDfnGanWxP3iN5b9GeONSPbQgjA=">AAACeXichVHLSgMxFD0d3/VVHwvBTbVUiouSqqi4Ety4rNY+QKXMTFMNzouZtNAWf8AfcOFGBZHqZ7jxB1z4CeJSwYUuvJ0OiBb1hiQnJ/fcnCSaYwhPMvYYUrq6e3r7+gfCg0PDI6ORsfGcZ1dcnWd127DdgqZ63BAWz0ohDV5wXK6amsHz2tFGaz9f5a4nbGtH1hy+b6oHligLXZVEFSOTmZolD7kn6rwUzatVXrZdsxiJsSTzI9oJUgGIIYi0HbnGHkqwoaMCExwWJGEDKjxqu0iBwSFuHw3iXELC3+c4Rpi0FcrilKESe0TjAa12A9aidaum56t1OsWg7pIyijh7YE32wu7ZLXtiH7/Wavg1Wl5qNGttLXeKoydTmbd/VSbNEodfqj89S5Sx6nsV5N3xmdYt9La+Wj99yaxtxxtz7JI9k/8L9sju6AZW9VW/2uLbZwjTB6R+PncnyC0kU8vJxa2F2PpS8BX9mMYsEvTeK1jHJtLI0rl1nKOJm9C7MqMklPl2qhIKNBP4FsriJ6JSkmg=</latexit> Synthesized Waveform <latexit sha1_base64="2ubV1qqnZXRUSZXlGfdk7joEZEY=">AAACgHichVE9TxtBEH1cIIAhwYEGieYUy4gmzpxjAXZlyU1KG8eABMi6u6zJivXd6T6sEMsFLX+AggokhCIa8hvS8AdS8BMiSpBoUmTufAhRkMxqd2ffzJt9O2t5SgYh0fWI9mJ07OX4xGRmavrV65nsm9n1wI18W7RsV7n+pmUGQklHtEIZKrHp+cLsWkpsWHu1OL7RE34gXedTuO+Jna6568iOtM2QoXZ2ob9tdfRmZL3z5Feh9Jrr9FwVxcFBO5ujQpnKJSKdCpQYOyUqrhQN3UiRHFKru9lzbOMzXNiI0IWAg5B9BRMBjy0YIHiM7aDPmM+eTOICA2SYG3GW4AyT0T1ed/m0laIOn+OaQcK2+RbF02emjjz9ou90S1d0Qb/pz7O1+kmNWMs+79aQK7z2zOF88/6/rC7vIb48sv6pOUQHq4lWydq9BIlfYQ/5vW9Ht83KWr6/SKd0w/pP6Jp+8guc3p191hBrx8jwBzx0WX/eWS8WjOXCh0YxVy2lXzGBBbzFEvd7BVV8RB0tvvcA57jED03TlrT3mjFM1UZSzhyemFb5C+pXlEk=</latexit> Sub-pixel Convolution <latexit sha1_base64="DdwdgvMaDN83VKPAOwTtDdmQY0g=">AAACl3ichVHNSiNBEP4cddWsu0a9uHgZDMoeltCJv+SiIIhHo0YFI2FmthMbZ3qG6U5QQ17AF1DwpCCL+A5ePOgLePARxKMLXjxYmQyIirvVdHf1V/VVfd1tB65QmrG7NqO9o/NLV3dP4mvvt+99yf6BNeVXQ4cXHN/1ww3bUtwVkhe00C7fCEJuebbL1+2d+WZ8vcZDJXy5qvcCvuVZFSnKwrE0QaVktqj5rq4XAmV51E9WcmajqIXHlTnzy2wFTWfbkpK7KmdmJ6capWSKpVlk5kcnEzspxLbkJ/+giN/w4aAKDxwSmnwXFhSNTWTAEBC2hTphIXkiinM0kCBulbI4ZViE7tBaodNmjEo6N2uqiO1QF5dmSEwTo+yWnbNHdsMu2D17/rRWParR1LJHu93i8qDUdzC08vRflke7xvYr65+aNcqYibQK0h5ESPMWTotf2z98XMktj9bH2Cl7IP0n7I5d0Q1k7a9zlufLx0jQB2TeP/dHZy2bzkylx/MTqbmJ+Cu6MYwR/KT3nsYcFrGEAvU9wiWucWP8MGaNBWOxlWq0xZxBvDEj/wLT9ZzH</latexit> Upsampling: ⇥ 8, channels: 256 <latexit sha1_base64="KJ7XXn/zBunvgXFFtc5qwHlyOl8=">AAACl3ichVFPSxtBFP+5/aOmtcb2YullaVA8lDAbg4ZcFATJMTGNCkbC7nYSh+zOLjuToC75Av0CCp5akFL6Hbx4qF+gh3yE0qOFXnroy2ahtKK+YWbe/N77vfebGSf0hNKMDSeMBw8fPZ6cms48eTrzbDY793xbBb3I5Q038IJo17EV94TkDS20x3fDiNu+4/Edp7sxiu/0eaREIN/qo5Dv+3ZHirZwbU1QK1toan6o40aobJ/6yU7ZHDS18LkyS2/McdB0D2wpuafKplUoDVrZHMuzxMybjpU6OaRWDbKf0MQ7BHDRgw8OCU2+BxuKxh4sMISE7SMmLCJPJHGOATLE7VEWpwyb0C6tHTrtpaik86imStgudfFoRsQ0scC+sc/sml2xL+w7+31rrTipMdJyRLsz5vKwNft+vv7rXpZPu8bBX9admjXaKCVaBWkPE2R0C3fM7x+fXNfLWwvxIvvIfpD+D2zILukGsv/TPa/xrTNk6AOs/5/7prNdyFsr+eVaMbdeTL9iCq/wGkv03qtYRwVVNKjvKS7wFVfGS2PN2DQq41RjIuW8wD9m1P4Az+6cxQ==</latexit> Upsampling: ⇥ 8, channels: 128 <latexit sha1_base64="2ubV1qqnZXRUSZXlGfdk7joEZEY=">AAACgHichVE9TxtBEH1cIIAhwYEGieYUy4gmzpxjAXZlyU1KG8eABMi6u6zJivXd6T6sEMsFLX+AggokhCIa8hvS8AdS8BMiSpBoUmTufAhRkMxqd2ffzJt9O2t5SgYh0fWI9mJ07OX4xGRmavrV65nsm9n1wI18W7RsV7n+pmUGQklHtEIZKrHp+cLsWkpsWHu1OL7RE34gXedTuO+Jna6568iOtM2QoXZ2ob9tdfRmZL3z5Feh9Jrr9FwVxcFBO5ujQpnKJSKdCpQYOyUqrhQN3UiRHFKru9lzbOMzXNiI0IWAg5B9BRMBjy0YIHiM7aDPmM+eTOICA2SYG3GW4AyT0T1ed/m0laIOn+OaQcK2+RbF02emjjz9ou90S1d0Qb/pz7O1+kmNWMs+79aQK7z2zOF88/6/rC7vIb48sv6pOUQHq4lWydq9BIlfYQ/5vW9Ht83KWr6/SKd0w/pP6Jp+8guc3p191hBrx8jwBzx0WX/eWS8WjOXCh0YxVy2lXzGBBbzFEvd7BVV8RB0tvvcA57jED03TlrT3mjFM1UZSzhyemFb5C+pXlEk=</latexit> Sub-pixel Convolution <latexit sha1_base64="8alTA29z8UbrN8Xi4bDvDjxzaaI=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t</latexit> Conv1D <latexit sha1_base64="ebYl+k5+WRNgMwpH0Pwimsu3rd4=">AAACbXichVHLSgMxFD0d3/XRqgiCIsVSdSElVVHpquDGZatWi1VkZkxr6DQzzEwLWvwB14ILUVAQET/DjT/gwk8QFy4U3LjwdjogWtQbkpyc3HNzkmiWIRyXsceA0tLa1t7R2RXs7untC4X7B9Yds2LrPKubhmnnNNXhhpA86wrX4DnL5mpZM/iGVlqq729Uue0IU665+xbfLqtFKQpCV12iNkvcltxIRhamd8JRFmdeRJpBwgdR+JE2w9fYwi5M6KigDA4Jl7ABFQ61PBJgsIjbRo04m5Dw9jkOESRthbI4ZajElmgs0irvs5LW9ZqOp9bpFIO6TcoIYuyB3bBXds9u2RP7+LVWzatR97JPs9bQcmsndDS8+v6vqkyzi70v1Z+eXRSw6HkV5N3ymPot9Ia+enDyuppcidUm2CV7Jv8X7JHd0Q1k9U2/yvCVUwTpAxI/n7sZrM/EE/Px2cxMNDXnf0UnRjCOKXrvBaSwjDSydK7EMc5wHnhRhpRRZayRqgR8zSC+hTL5CeKOjRA=</latexit> kernel: 7, <latexit sha1_base64="tje9uKLk9X1ITjVGGRju/tx+xWY=">AAACbnichVFNS8NAEH2NX7V+tCqIIGKwKJ7KtBa/TgUvHttqbaGKJHG1oWkSkrSgxT/gXTwIioKI+DO8+Ac8+BPEi6DgxYPTNCIe1Fl2d/btvNm3M6pt6K5H9BiSOjq7unvCvZG+/oHBaGxoeMO16o4mCpplWE5JVVxh6KYoeLpniJLtCKWmGqKoVlda98WGcFzdMte9fVts1ZQ9U9/VNcVjqKxVFNMUhrssp7djcUos0VKaSKYE+cZOmlILqaScDJA4AstasWtsYgcWNNRRg4AJj30DClweZSRBsBnbQpMxhz3dvxc4RIS5dY4SHKEwWuV1j0/lADX53Mrp+myNXzF4OsyUMU0PdEOvdE+39EQfv+Zq+jlaWvZ5V9tcYW9Hj8bW3v9l1Xj3UPlm/anZwy4Wfa06a7d9pPULrc1vHJy8ri3np5szdEnPrP+CHumOf2A23rSrnMifIsIN+Kqy/LuzkUok5xNzuVQ8kw5aEcY4pjDL9V5ABqvIouBX7BhnOA+9SKPShDTZDpVCAWcEP0ya/QSOJY3c</latexit> channels: 4 <latexit sha1_base64="j3ICVDtpWN1T1qjHV9/vB2DDNDw=">AAACbHichVG7SgNBFD1Z3/GR+CiEIARDxCpMVFSsBEFsBJOYhyQiu+skLtkXu5tADPkBWwsLtVAQET/Dxh+wyCeIYBPBxsKbzYJoUO8wM2fO3HPnzIxkqortMNb0CT29ff0Dg0P+4ZHRsUBwfCJjGxVL5mnZUA0rJ4k2VxWdpx3FUXnOtLioSSrPSuWN9n62yi1bMfRdp2byfU0s6UpRkUWHqL16QSqGt5ObjYNghMWYG+FuEPdABF7sGMFbFHAIAzIq0MChwyGsQoRNLY84GEzi9lEnziKkuPscDfhJW6EsThkisWUaS7TKe6xO63ZN21XLdIpK3SJlGFH2xO5Yiz2ye/bMPn6tVXdrtL3UaJY6Wm4eBE6mU+//qjSaHRx9qf707KCIVderQt5Nl2nfQu7oq8dnrdRaMlqfY9fshfxfsSZ7oBvo1Tf5JsGT5/DTB8R/Pnc3yCzE4suxxcRCZH3J+4pBhDCLeXrvFaxjCztI07kaTnGBS9+rMCWEhJlOquDzNJP4FsLcJ36qjOk=</latexit> MRF <latexit sha1_base64="j3ICVDtpWN1T1qjHV9/vB2DDNDw=">AAACbHichVG7SgNBFD1Z3/GR+CiEIARDxCpMVFSsBEFsBJOYhyQiu+skLtkXu5tADPkBWwsLtVAQET/Dxh+wyCeIYBPBxsKbzYJoUO8wM2fO3HPnzIxkqortMNb0CT29ff0Dg0P+4ZHRsUBwfCJjGxVL5mnZUA0rJ4k2VxWdpx3FUXnOtLioSSrPSuWN9n62yi1bMfRdp2byfU0s6UpRkUWHqL16QSqGt5ObjYNghMWYG+FuEPdABF7sGMFbFHAIAzIq0MChwyGsQoRNLY84GEzi9lEnziKkuPscDfhJW6EsThkisWUaS7TKe6xO63ZN21XLdIpK3SJlGFH2xO5Yiz2ye/bMPn6tVXdrtL3UaJY6Wm4eBE6mU+//qjSaHRx9qf707KCIVderQt5Nl2nfQu7oq8dnrdRaMlqfY9fshfxfsSZ7oBvo1Tf5JsGT5/DTB8R/Pnc3yCzE4suxxcRCZH3J+4pBhDCLeXrvFaxjCztI07kaTnGBS9+rMCWEhJlOquDzNJP4FsLcJ36qjOk=</latexit> MRF <latexit sha1_base64="/dV5MgkluHnru+XweyIbtPS1sWI=">AAACenichVHNSsNAEP4a/+tfVQTBS7AoilCntbTqSdCDR/+qgkpJ4rYupklI0ooGX8AX8OBJQUR9DC++gAcfQTwqePHgNI2IB3WW3Zn9dr6Zb3d1x5SeT/QUU5qaW1rb2jvinV3dPb2Jvv4Nz666higYtmm7W7rmCVNaouBL3xRbjiu0im6KTf1goX6+WROuJ21r3T9yxG5FK1uyJA3NZ6iYGAx29JK6YFu19OKJejhlq7rUvGIiSanZXJ6m8yqlKDQOsplcNjerpiMkiciW7cQ1drAHGwaqqEDAgs+xCQ0ej22kQXAY20XAmMuRDM8FThBnbpWzBGdojB7wWubddoRavK/X9EK2wV1Mni4zVYzSI93QKz3QHT3Tx6+1grBGXcsRe73BFU6x93Ro7f1fVoW9j/1v1p+afZQwE2qVrN0JkfotjAa/dnz2uja3OhqM0SW9sP4LeqJ7voFVezOuVsTqOeL8AV+vrP4ebGRS6VxqeiWTnM9GX9GOYYxgnN87j3ksYRkF7hvgAre4i30oI8qEMtlIVWIRZwA/TMl+ArIDkes=</latexit> Conv1D w/o bias <latexit sha1_base64="z3mrFr7lUs4Scrf6174xqeOU9YY=">AAACh3ichVE9bxNBEH05PpI4QAw0SDSnWEE0mLFj5YMqUVxQ5gPHkUJk7V3GySp3t6e79UnBokf8AYpUREIIIaUNPQ1/gCI/AVEmUpoUjM+HEEVgVrsz+3bezNtdLw50aolOR5xr12/cHB0bL03cun1nsnz33kZqeonPLd8EJtn0VMqBjrhltQ14M05YhV7AbW9/eXDezjhJtYle2IOYt0O1G+mu9pUVqFOearhNZdWTZqIzjtwm+yaMTco7bltl3DVJmHbKFaou0EKDyKUq5SZBg+pz9ZpbK5AKClsx5Y94iR0Y+OghBCOClTiAQipjCzUQYsG20RcskUjn54zXKAm3J1ksGUrQfVl3ZbdVoJHsBzXTnO1Ll0BmIkwX0/SdPtEZfaPP9IMur6zVz2sMtByI94ZcjjuTbx+sX/yXFYq32PvD+qdmiy7mc61atMc5MriFP+Rnr96drT9bm+4/oiP6Kfrf0yl9lRtE2bn/YZXXDlGSD/j9yu7VwUa9WputzqzWK4uN4ivG8BBTeCzvPYdFPMcKWtL3DY5xgi/OuPPUmXXmh6nOSMG5j7/MWfoFBaqWeg==</latexit> 4 Data-Driven Decomposed Waveforms
  10. Parallel Tacotron 2 with forced alignment and accentual input Entire

    real-time neural TTS systems on CPUs 10 <latexit sha1_base64="BncMs2Qs+ixlCwpGPebRKNurz1M=">AAACbnichVHLSsNAFD2N7/qqCiKIWCyVrsptERVXgi50Vx99QC2SxGkNzYskLWjxB9yLC0FREBE/w40/4MJPEDeCghsX3qYBUVFvmMyZM/fcOXNHsXXN9YgeQlJbe0dnV3dPuLevf2AwMjScc62ao4qsaumWU1BkV+iaKbKe5umiYDtCNhRd5JXqUnM/XxeOq1nmprdni5IhV0ytrKmyx1Qxs2uZwhDR1WV3OxKjJPkR/QlSAYghiIwVucIWdmBBRQ0GBEx4jHXIcPkrIgWCzVwJDeYcRpq/L3CAMGtrnCU4Q2a2yv8Kr4oBa/K6WdP11SqfovNwWBlFnO7pml7ojm7okd5/rdXwazS97PGstLTC3h48HNt4+1dl8Oxh91P1p2cPZcz7XjX2bvtM8xZqS1/fP37ZWFiPN6bpgp7Y/zk90C3fwKy/qpdrYv0EYX6A1Pd2/wS5dDI1m6S1dGxxJniKboxjCgnu9xwWsYIMsn7HjnCKs9CzNCpNSJOtVCkUaEbwJaTEB2ZIjcU=</latexit> Phoneme IDs <latexit sha1_base64="qFvW4T3G/BvzmDwf1uAxvwSECnM=">AAACbHichVG7SgNBFD1Z3/EVH4UgQjAYYhNuVFSsBBtLX3lIDLK7jrq4L3YnAQ3+gK2FhVooiIifYeMPWPgJItgo2Fh4s1kQDeodZubMmXvunJnRXNPwJdFjRGlqbmlta++IdnZ19/TG+vpzvlP2dJHVHdPxCprqC9OwRVYa0hQF1xOqpZkir+0t1PbzFeH5hmOvyX1XlCx1xza2DV2VTK2nKC6d+OTs+GYsQWkKIt4IMiFIIIwlJ3aNDWzBgY4yLAjYkIxNqPC5FZEBwWWuhCpzHiMj2Bc4RJS1Zc4SnKEyu8fjDq+KIWvzulbTD9Q6n2Jy91gZxxg90A290j3d0hN9/FqrGtSoednnWatrhbvZezS0+v6vyuJZYvdL9adniW3MBl4N9u4GTO0Wel1fOTh5XZ1bGasm6ZKe2f8FPdId38CuvOlXy2LlFFH+gMzP524EuYl0ZjpNyxOJ+anwK9oxjFGk+L1nMI9FLCHL51o4xhnOIy/KoDKsjNRTlUioGcC3UJKfVO2L1A==</latexit> (0 to 38) <latexit sha1_base64="pt85Y7qqy4QLYQXc8oPrHwCAu8U=">AAACdHichVFNLwNRFD0dX1UfLTYSFo2mYtXciiBWxMZSS5EgzczzMPE6M5l5bULjD/gDFl0RIuJn2PgDFn6CWBI2Fm6nkwiCO3nzzjvvnvvOe9fylB1oooeY0dbe0dkV70709Pb1J1MDg2uBW/WFLAlXuf6GZQZS2Y4saVsrueH50qxYSq5bB4vN/fWa9APbdVb1oSe3K+aeY+/awtRMlVPJBSGko6umSivTkqqcylCOwkj/BPkIZBDFspu6whZ24EKgigokHGjGCiYC/jaRB8Fjbht15nxGdrgvcYwEa6ucJTnDZPaA/3u82oxYh9fNmkGoFnyK4uGzMo0s3dM1PdMd3dAjvf9aqx7WaHo55NlqaaVXTp4Mr7z9q6rwrLH/qfrTs8YuZkOvNnv3QqZ5C9HS145On1fmitn6OJ3TE/s/owe65Rs4tRdxWZDFBhLcgPz35/4J1iZz+ekcFSYz81NRK+IYwRgm+L1nMI8lLKMU9qSBC1zGXo1RI2NkW6lGLNIM4UsYuQ8eAI/i</latexit> Accentual label <latexit sha1_base64="h3mR15UrzBMJ9GZSLvGZuvXVtT4=">AAACaXichVHLSsNAFD2Nr1ofbXVTdFMsiqtyU0TFVcGNy2rtA1QkiVONTZOQpIVa/AFX7kRdKYiIn+HGH3DRTxCXCm5ceJsGRIt6h5k5c+aeO2dmVNvQXY+oHZL6+gcGh8LDkZHRsfFoLD5RdK26o4mCZhmWU1YVVxi6KQqe7hmibDtCqamGKKnV1c5+qSEcV7fMTa9pi52asm/qFV1TPKaKlLScpLwbS1Ga/Ej2AjkAKQSRs2K32MYeLGioowYBEx5jAwpcbluQQbCZ20GLOYeR7u8LHCPC2jpnCc5QmK3yuM+rrYA1ed2p6fpqjU8xuDusTGKWnuiOXumR7umZPn6t1fJrdLw0eVa7WmHvRk8S+fd/VTWePRx8qf707KGCZd+rzt5tn+ncQuvqG0dnr/mVjdnWHF3TC/u/ojY98A3Mxpt2sy42LhHhD5B/PncvKGbS8mKa1jOp7ELwFWFMYwbz/N5LyGINORT43EOc4hwXoRcpLiWkqW6qFAo0k/gWUuoTxf6LKQ==</latexit> 0 or 1 <latexit sha1_base64="fkvLtFSp9EoAQNVSJPFcoRwKT2o=">AAACbHichVG7SgNBFD1ZXzE+Eh+FIIIYDFbhRkTFKiCCpYnGByphdzPGIftidxPQ4A/YWliohYKI+Bk2/oCFnyCCjYKNhTebBVFR7zAzZ87cc+fMjOYY0vOJHiJKS2tbe0e0M9bV3dMbT/T1r3p21dVFQbcN213XVE8Y0hIFX/qGWHdcoZqaIda0ynxjf60mXE/a1oq/54htUy1bckfqqs/UxoKpiVJJWuViIklpCmL0J8iEIIkwluzEFbZQgg0dVZgQsOAzNqDC47aJDAgOc9uoM+cyksG+wAFirK1yluAMldkKj2VebYasxetGTS9Q63yKwd1l5SjG6Z6u6YXu6IYe6f3XWvWgRsPLHs9aUyucYvxwaPntX5XJs4/dT9Wfnn3sYDbwKtm7EzCNW+hNfW3/+GV5Lj9eT9EFPbH/c3qgW76BVXvVL3Mif4IYf0Dm+3P/BKuT6cx0mnKTyexU+BVRDGMME/zeM8hiEUso8LkmjnCKs8izMqgMKyPNVCUSagbwJZTUBzowjUQ=</latexit> Embedding <latexit sha1_base64="fkvLtFSp9EoAQNVSJPFcoRwKT2o=">AAACbHichVG7SgNBFD1ZXzE+Eh+FIIIYDFbhRkTFKiCCpYnGByphdzPGIftidxPQ4A/YWliohYKI+Bk2/oCFnyCCjYKNhTebBVFR7zAzZ87cc+fMjOYY0vOJHiJKS2tbe0e0M9bV3dMbT/T1r3p21dVFQbcN213XVE8Y0hIFX/qGWHdcoZqaIda0ynxjf60mXE/a1oq/54htUy1bckfqqs/UxoKpiVJJWuViIklpCmL0J8iEIIkwluzEFbZQgg0dVZgQsOAzNqDC47aJDAgOc9uoM+cyksG+wAFirK1yluAMldkKj2VebYasxetGTS9Q63yKwd1l5SjG6Z6u6YXu6IYe6f3XWvWgRsPLHs9aUyucYvxwaPntX5XJs4/dT9Wfnn3sYDbwKtm7EzCNW+hNfW3/+GV5Lj9eT9EFPbH/c3qgW76BVXvVL3Mif4IYf0Dm+3P/BKuT6cx0mnKTyexU+BVRDGMME/zeM8hiEUso8LkmjnCKs8izMqgMKyPNVCUSagbwJZTUBzowjUQ=</latexit> Embedding <latexit sha1_base64="STpKfrz90sxwISBg4dntFxzkIi0=">AAACZnichVHLSsNAFD2Nr1pfVREFN8VScVVupWhxVXDjsg/bCiqSxLGGpklI0kIt/oDg1i5cKYiIn+HGH3DRP1BcVnDjwts0IFrUO8zMmTP33Dkzo1i65rhE7YA0MDg0PBIcDY2NT0xOhadnio5Zs1VRUE3dtHcU2RG6ZoiCq7m62LFsIVcVXZSUymZ3v1QXtqOZxrbbsMR+VS4b2pGmyi5T+WQydRCOUpy8iPSDhA+i8CNjhm+xh0OYUFFDFQIGXMY6ZDjcdpEAwWJuH03mbEaaty9wihBra5wlOENmtsJjmVe7PmvwulvT8dQqn6Jzt1kZQYye6I469Ej39EIfv9ZqejW6Xho8Kz2tsA6mzhby7/+qqjy7OP5S/enZxRFSnleNvVse072F2tPXT1qd/EYu1lyma3pl/1fUpge+gVF/U2+yIneJEH9A4udz94PiajyxFqfsajSd9L8iiEUsYYXfex1pbCGDAp9bxjku0Ao8S5PSnDTfS5UCvmYW30KKfAKOiYop</latexit> 448 <latexit sha1_base64="0V0kJ2ezP432UNmx+8phNvYoPjA=">AAACZXichVHLSsNAFD2Nr1ofrQ9EcGGxKK7KbSlVXAluXNrWaqEWSeJUQ9MkJGmhFn9A3KoLVwoi4me48Qdc9AtEXFZw48LbNCAq6h1m5syZe+6cmVEsXXNcolZA6unt6x8IDoaGhkdGw5Gx8S3HrNmqyKumbtoFRXaErhki72quLgqWLeSqoottpbLW2d+uC9vRTGPTbViiVJX3Da2sqbLLVDad2o3EKE5eRH+ChA9i8GPDjNxgB3swoaKGKgQMuIx1yHC4FZEAwWKuhCZzNiPN2xc4Qoi1Nc4SnCEzW+Fxn1dFnzV43anpeGqVT9G526yMYp4e6Zba9EB39Ezvv9ZqejU6Xho8K12tsHbDx9O5t39VVZ5dHHyq/vTsooxlz6vG3i2P6dxC7errh+ft3Ep2vrlAV/TC/i+pRfd8A6P+ql5nRPYCIf6AxPfn/gm2kvFEOk6ZZGw15X9FEDOYwyK/9xJWsY4N5PncMk5wirPAkzQiTUpT3VQp4Gsm8CWk2Q/8sonp</latexit> 64 <latexit sha1_base64="MBqVKx8Qh+SaYbcndjGrr2Q0FYw=">AAACcHichVG7SgNBFD1Z3/GRqE3AwmhQxCLciKhYCTaWURMNxBB214ku7svZTUCDP+APWNioICJ+ho0/YOEniJ0RbCy82SyIBvUOM3PmzD13zsxorml4PtFTROno7Oru6e2L9g8MDsXiwyNbnlOVusjrjunIgqZ6wjRskfcN3xQFVwrV0kyxrR2sNve3a0J6hmPn/CNXlCx1zzYqhq76TJUWkjmp2l7FkZaQ5XiK0hREsh1kQpBCGFknfoMd7MKBjiosCNjwGZtQ4XErIgOCy1wJdeYkIyPYFzhBlLVVzhKcoTJ7wOMer4oha/O6WdML1DqfYnKXrExiih7plhr0QHf0TB+/1qoHNZpejnjWWlrhlmOnic33f1UWzz72v1R/evZRwVLg1WDvbsA0b6G39LXjs8bm8sZUfZqu6IX9X9IT3fMN7Nqbfr0uNs4R5Q/I/HzudrA1l84spGl9LrUyH35FL8YwiRl+70WsYA1Z5PncQ5zhApeRVyWhjCsTrVQlEmpG8S2U2U+xAo7W</latexit> 6 Transformer <latexit sha1_base64="G+BIts03qXCra6hQZf1QCqjPIfw=">AAACanichVG7SgNBFD1Z3/EVY6OkCUbFKtyEoGIlpLGwyMMYQUV211EX98XuZiEGf8DOSjCVgoj4GTb+gEU+QbRTsLHwZrMgKuodZubMmXvunJlRbF1zPaJWROrq7unt6x+IDg4Nj4zGxuLrrlVzVFFRLd1yNhTZFbpmioqnebrYsB0hG4ouqsphvr1f9YXjapa55tVtsW3I+6a2p6myx1Q1l1zNW6a/E0tRmoJI/gSZEKQQRsGKXWMLu7CgogYDAiY8xjpkuNw2kQHBZm4bDeYcRlqwL3CMKGtrnCU4Q2b2kMd9Xm2GrMnrdk03UKt8is7dYWUSM/RAN/RC93RLj/T+a61GUKPtpc6z0tEKe2f0ZKL89q/K4NnDwafqT88e9rAYeNXYux0w7VuoHb1/dPZSXirNNGbpkp7Y/wW16I5vYPqv6lVRlJqI8gdkvj/3T7CeTWfm01TMppZz4Vf0I4EpzPF7L2AZKyigErg7xTmakWcpLk1KiU6qFAk14/gS0vQHVOKL5w==</latexit> 4 LConv <latexit sha1_base64="J38KKMxaNO+ed8dMKtRnf4qrO3s=">AAAChnichVHLSiNBFD22rxgdjboR3LQGB2cTbvvGVdCNS19RwUjo7im1SL/orgQ1ZC34Ay5cKYiIuNUPcOMPuPATxKUDs5nF3HQaxJGZuUVVnTp1z61TVVbgyEgRPbdorW3tHZ2prnR3z5fevkz/wEbkV0JbFGzf8cMty4yEIz1RUFI5YisIhelajti0youN/c2qCCPpe+vqMBA7rrnnyV1pm4qpUmakqMSBqi04vl3Wxyf1elFJV0R6k9aNb/VSJks5ikP/DIwEZJHEsp+5QhHf4cNGBS4EPCjGDkxE3LZhgBAwt4MacyEjGe8L1JFmbYWzBGeYzJZ53OPVdsJ6vG7UjGK1zac43ENW6hijJ7qmN3qkG3qhX3+tVYtrNLwc8mw1tSIo9Z0Mrf38r8rlWWH/XfVPzwq7mIu9SvYexEzjFnZTXz06fVubXx2rfaULemX/5/RMD3wDr/rDvlwRq2dI8wcYfz73Z7AxkTNmcrQylc1PJV+RwjBGMc7vPYs8lrCMAp97jFvc4V5LaTltWpttpmotiWYQH0LL/wZ6IJW5</latexit> Block (3 ⇥ 1) <latexit sha1_base64="/gSmtVp4PpLyMkkTIPQRPP8rcso=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgqilBui6i4Ety47MOqYEtJ4lijaRKStFCLP+AH6MKFDxARP8ONP+DCTxBXouDGhTdpQLSod5iZM2fuuXNmRrF0zXGJHkNSW3tHZ1d3T7i3r39gMDI0vO6YVVsVedXUTXtTkR2ha4bIu5qri03LFnJF0cWGsr/i7W/UhO1oprHm1i1RrMhlQ9vRVNllqpC2zT2hejA6W4rEKEF+RFtBMgAxBJE2I9coYBsmVFRRgYABl7EOGQ63LSRBsJgrosGczUjz9wUOEWZtlbMEZ8jM7vNY5tVWwBq89mo6vlrlU3TuNiujiNMD3dAr3dMtPdHHr7Uafg3PS51npakVVmnwaCz3/q+qwrOL3S/Vn55d7GDR96qxd8tnvFuoTX3t4OQ1t5SNN6bokp7Z/wU90h3fwKi9qVcZkT1FmD8g+fO5W8F6KpGcT1AmFVueC76iG+OYxDS/9wKWsYo08nyuhWOc4Tz0Io1KE1K0mSqFAs0IvoU08wmJoY5L</latexit> Projection + <latexit sha1_base64="SfRCaXHX44rfsJibchh8cW6i1ko=">AAACa3ichVHLSsNAFD2Nr1pf1W5EXRRLxVW5FVFxVXDj0rZWC1UkidMamiYhmRZq8QdcunGhGwUR8TPc+AMu/AQRVwpuXHibBkSLesNkzpy5586ZO5pjGp4kegwpPb19/QPhwcjQ8MjoWHR8Ysuz664uCrpt2m5RUz1hGpYoSEOaoui4Qq1pptjWqmvt/e2GcD3DtjZl0xG7NbViGWVDVyVTxbxdlo5Z9/aiCUqRH/FukA5AAkFs2NFr7GAfNnTUUYOABcnYhAqPvxLSIDjM7aLFnMvI8PcFjhBhbZ2zBGeozFb5X+FVKWAtXrdrer5a51NMHi4r40jSA93QK93TLT3Rx6+1Wn6Ntpcmz1pHK5y9sePJ/Pu/qhrPEgdfqj89S5Sx4ns12LvjM+1b6B194/D0Nb+aS7bm6JKe2f8FPdId38BqvOlXWZE7Q4QfIP2z3d1gayGVXkpRdiGRWQyeIoxpzGKe+72MDNaxgYLf5xOc4Tz0osSUKWWmk6qEAk0M30JJfgLUmY0b</latexit> Softplus <latexit sha1_base64="F4xwm5t7SFDYPxE276wFOaQcXLA=">AAACbnichVHLSsNAFD2Nr1pfVUEEEYul0lWZVlFxVezGhYs+bBVqkSRONTRNQpIGavEH3IsLQVEQET/DjT/gop8gboQKblx4mwZEi3rDZM6cuefOmTuSoSqWzVjTJ/T09vUP+AcDQ8Mjo2PB8YmCpddMmedlXdXNHUm0uKpoPG8rtsp3DJOLVUnl21Il1d7fdrhpKbq2ZdcNXqqKB5pSVmTRJqq4mdI1J7Su6nJlLxhmMeZGqBvEPRCGF2k9eItd7EOHjBqq4NBgE1YhwqKviDgYDOJKaBBnElLcfY5jBEhboyxOGSKxFfof0KrosRqt2zUtVy3TKSoNk5QhRNgTu2Mt9sju2TP7+LVWw63R9lKnWepoubE3djKde/9XVaXZxuGX6k/PNspYdb0q5N1wmfYt5I7eOTpr5daykcYCu2Yv5P+KNdkD3UBz3uSbDM+eI0APEP/Z7m5QSMTiy7HFTCKcXPKewo8ZzCNK/V5BEhtII+927BQXuPS9ClPCrDDXSRV8nmYS30KIfgJncY3J</latexit> LConv Block <latexit sha1_base64="RuuOEL7N73jZiBP4PDimSQcDG9Y=">AAACcHichVHNLkNBGD29/qp+WmwkFkpDsGjm0iBWEhtLSmlSjdx7TWvS++feaRMaL+AFurBBIiIew8YLWHgEsUNiY+Hr7U0EwTeZmTNnvvPNmRndNYUvGXuIKG3tHZ1d0e5YT29ffzwxMLjlO1XP4DnDMR0vr2s+N4XNc1JIk+ddj2uWbvJtvbLS3N+ucc8Xjr0pD11etLSyLUrC0CRRxSl1IbkjhcX9pDq9m0ixNAsi+ROoIUghjDUncYUd7MGBgSoscNiQhE1o8KkVoILBJa6IOnEeIRHscxwjRtoqZXHK0Iit0FimVSFkbVo3a/qB2qBTTOoeKZOYYPfsmr2wO3bDHtn7r7XqQY2ml0Oa9ZaWu7vxk+GNt39VFs0S+5+qPz1LlLAYeBXk3Q2Y5i2Mlr521HjZWMpO1CfZBXsi/+fsgd3SDezaq3G5zrOniNEHqN+f+yfYmk2r8+m59UxqORN+RRQjGMcUvfcClrGKNeTo3AM0cIbzyLMyrIwqY61UJRJqhvAllJkPK3+Nmg==</latexit> (17 ⇥ 1) <latexit sha1_base64="F4xwm5t7SFDYPxE276wFOaQcXLA=">AAACbnichVHLSsNAFD2Nr1pfVUEEEYul0lWZVlFxVezGhYs+bBVqkSRONTRNQpIGavEH3IsLQVEQET/DjT/gop8gboQKblx4mwZEi3rDZM6cuefOmTuSoSqWzVjTJ/T09vUP+AcDQ8Mjo2PB8YmCpddMmedlXdXNHUm0uKpoPG8rtsp3DJOLVUnl21Il1d7fdrhpKbq2ZdcNXqqKB5pSVmTRJqq4mdI1J7Su6nJlLxhmMeZGqBvEPRCGF2k9eItd7EOHjBqq4NBgE1YhwqKviDgYDOJKaBBnElLcfY5jBEhboyxOGSKxFfof0KrosRqt2zUtVy3TKSoNk5QhRNgTu2Mt9sju2TP7+LVWw63R9lKnWepoubE3djKde/9XVaXZxuGX6k/PNspYdb0q5N1wmfYt5I7eOTpr5daykcYCu2Yv5P+KNdkD3UBz3uSbDM+eI0APEP/Z7m5QSMTiy7HFTCKcXPKewo8ZzCNK/V5BEhtII+927BQXuPS9ClPCrDDXSRV8nmYS30KIfgJncY3J</latexit> LConv Block <latexit sha1_base64="RuuOEL7N73jZiBP4PDimSQcDG9Y=">AAACcHichVHNLkNBGD29/qp+WmwkFkpDsGjm0iBWEhtLSmlSjdx7TWvS++feaRMaL+AFurBBIiIew8YLWHgEsUNiY+Hr7U0EwTeZmTNnvvPNmRndNYUvGXuIKG3tHZ1d0e5YT29ffzwxMLjlO1XP4DnDMR0vr2s+N4XNc1JIk+ddj2uWbvJtvbLS3N+ucc8Xjr0pD11etLSyLUrC0CRRxSl1IbkjhcX9pDq9m0ixNAsi+ROoIUghjDUncYUd7MGBgSoscNiQhE1o8KkVoILBJa6IOnEeIRHscxwjRtoqZXHK0Iit0FimVSFkbVo3a/qB2qBTTOoeKZOYYPfsmr2wO3bDHtn7r7XqQY2ml0Oa9ZaWu7vxk+GNt39VFs0S+5+qPz1LlLAYeBXk3Q2Y5i2Mlr521HjZWMpO1CfZBXsi/+fsgd3SDezaq3G5zrOniNEHqN+f+yfYmk2r8+m59UxqORN+RRQjGMcUvfcClrGKNeTo3AM0cIbzyLMyrIwqY61UJRJqhvAllJkPK3+Nmg==</latexit> (17 ⇥ 1) <latexit sha1_base64="F4xwm5t7SFDYPxE276wFOaQcXLA=">AAACbnichVHLSsNAFD2Nr1pfVUEEEYul0lWZVlFxVezGhYs+bBVqkSRONTRNQpIGavEH3IsLQVEQET/DjT/gop8gboQKblx4mwZEi3rDZM6cuefOmTuSoSqWzVjTJ/T09vUP+AcDQ8Mjo2PB8YmCpddMmedlXdXNHUm0uKpoPG8rtsp3DJOLVUnl21Il1d7fdrhpKbq2ZdcNXqqKB5pSVmTRJqq4mdI1J7Su6nJlLxhmMeZGqBvEPRCGF2k9eItd7EOHjBqq4NBgE1YhwqKviDgYDOJKaBBnElLcfY5jBEhboyxOGSKxFfof0KrosRqt2zUtVy3TKSoNk5QhRNgTu2Mt9sju2TP7+LVWw63R9lKnWepoubE3djKde/9XVaXZxuGX6k/PNspYdb0q5N1wmfYt5I7eOTpr5daykcYCu2Yv5P+KNdkD3UBz3uSbDM+eI0APEP/Z7m5QSMTiy7HFTCKcXPKewo8ZzCNK/V5BEhtII+927BQXuPS9ClPCrDDXSRV8nmYS30KIfgJncY3J</latexit> LConv Block <latexit sha1_base64="RuuOEL7N73jZiBP4PDimSQcDG9Y=">AAACcHichVHNLkNBGD29/qp+WmwkFkpDsGjm0iBWEhtLSmlSjdx7TWvS++feaRMaL+AFurBBIiIew8YLWHgEsUNiY+Hr7U0EwTeZmTNnvvPNmRndNYUvGXuIKG3tHZ1d0e5YT29ffzwxMLjlO1XP4DnDMR0vr2s+N4XNc1JIk+ddj2uWbvJtvbLS3N+ucc8Xjr0pD11etLSyLUrC0CRRxSl1IbkjhcX9pDq9m0ixNAsi+ROoIUghjDUncYUd7MGBgSoscNiQhE1o8KkVoILBJa6IOnEeIRHscxwjRtoqZXHK0Iit0FimVSFkbVo3a/qB2qBTTOoeKZOYYPfsmr2wO3bDHtn7r7XqQY2ml0Oa9ZaWu7vxk+GNt39VFs0S+5+qPz1LlLAYeBXk3Q2Y5i2Mlr521HjZWMpO1CfZBXsi/+fsgd3SDezaq3G5zrOniNEHqN+f+yfYmk2r8+m59UxqORN+RRQjGMcUvfcClrGKNeTo3AM0cIbzyLMyrIwqY61UJRJqhvAllJkPK3+Nmg==</latexit> (17 ⇥ 1) <latexit sha1_base64="F4xwm5t7SFDYPxE276wFOaQcXLA=">AAACbnichVHLSsNAFD2Nr1pfVUEEEYul0lWZVlFxVezGhYs+bBVqkSRONTRNQpIGavEH3IsLQVEQET/DjT/gop8gboQKblx4mwZEi3rDZM6cuefOmTuSoSqWzVjTJ/T09vUP+AcDQ8Mjo2PB8YmCpddMmedlXdXNHUm0uKpoPG8rtsp3DJOLVUnl21Il1d7fdrhpKbq2ZdcNXqqKB5pSVmTRJqq4mdI1J7Su6nJlLxhmMeZGqBvEPRCGF2k9eItd7EOHjBqq4NBgE1YhwqKviDgYDOJKaBBnElLcfY5jBEhboyxOGSKxFfof0KrosRqt2zUtVy3TKSoNk5QhRNgTu2Mt9sju2TP7+LVWw63R9lKnWepoubE3djKde/9XVaXZxuGX6k/PNspYdb0q5N1wmfYt5I7eOTpr5daykcYCu2Yv5P+KNdkD3UBz3uSbDM+eI0APEP/Z7m5QSMTiy7HFTCKcXPKewo8ZzCNK/V5BEhtII+927BQXuPS9ClPCrDDXSRV8nmYS30KIfgJncY3J</latexit> LConv Block <latexit sha1_base64="RuuOEL7N73jZiBP4PDimSQcDG9Y=">AAACcHichVHNLkNBGD29/qp+WmwkFkpDsGjm0iBWEhtLSmlSjdx7TWvS++feaRMaL+AFurBBIiIew8YLWHgEsUNiY+Hr7U0EwTeZmTNnvvPNmRndNYUvGXuIKG3tHZ1d0e5YT29ffzwxMLjlO1XP4DnDMR0vr2s+N4XNc1JIk+ddj2uWbvJtvbLS3N+ucc8Xjr0pD11etLSyLUrC0CRRxSl1IbkjhcX9pDq9m0ixNAsi+ROoIUghjDUncYUd7MGBgSoscNiQhE1o8KkVoILBJa6IOnEeIRHscxwjRtoqZXHK0Iit0FimVSFkbVo3a/qB2qBTTOoeKZOYYPfsmr2wO3bDHtn7r7XqQY2ml0Oa9ZaWu7vxk+GNt39VFs0S+5+qPz1LlLAYeBXk3Q2Y5i2Mlr521HjZWMpO1CfZBXsi/+fsgd3SDezaq3G5zrOniNEHqN+f+yfYmk2r8+m59UxqORN+RRQjGMcUvfcClrGKNeTo3AM0cIbzyLMyrIwqY61UJRJqhvAllJkPK3+Nmg==</latexit> (17 ⇥ 1) <latexit sha1_base64="F4xwm5t7SFDYPxE276wFOaQcXLA=">AAACbnichVHLSsNAFD2Nr1pfVUEEEYul0lWZVlFxVezGhYs+bBVqkSRONTRNQpIGavEH3IsLQVEQET/DjT/gop8gboQKblx4mwZEi3rDZM6cuefOmTuSoSqWzVjTJ/T09vUP+AcDQ8Mjo2PB8YmCpddMmedlXdXNHUm0uKpoPG8rtsp3DJOLVUnl21Il1d7fdrhpKbq2ZdcNXqqKB5pSVmTRJqq4mdI1J7Su6nJlLxhmMeZGqBvEPRCGF2k9eItd7EOHjBqq4NBgE1YhwqKviDgYDOJKaBBnElLcfY5jBEhboyxOGSKxFfof0KrosRqt2zUtVy3TKSoNk5QhRNgTu2Mt9sju2TP7+LVWw63R9lKnWepoubE3djKde/9XVaXZxuGX6k/PNspYdb0q5N1wmfYt5I7eOTpr5daykcYCu2Yv5P+KNdkD3UBz3uSbDM+eI0APEP/Z7m5QSMTiy7HFTCKcXPKewo8ZzCNK/V5BEhtII+927BQXuPS9ClPCrDDXSRV8nmYS30KIfgJncY3J</latexit> LConv Block <latexit sha1_base64="RuuOEL7N73jZiBP4PDimSQcDG9Y=">AAACcHichVHNLkNBGD29/qp+WmwkFkpDsGjm0iBWEhtLSmlSjdx7TWvS++feaRMaL+AFurBBIiIew8YLWHgEsUNiY+Hr7U0EwTeZmTNnvvPNmRndNYUvGXuIKG3tHZ1d0e5YT29ffzwxMLjlO1XP4DnDMR0vr2s+N4XNc1JIk+ddj2uWbvJtvbLS3N+ucc8Xjr0pD11etLSyLUrC0CRRxSl1IbkjhcX9pDq9m0ixNAsi+ROoIUghjDUncYUd7MGBgSoscNiQhE1o8KkVoILBJa6IOnEeIRHscxwjRtoqZXHK0Iit0FimVSFkbVo3a/qB2qBTTOoeKZOYYPfsmr2wO3bDHtn7r7XqQY2ml0Oa9ZaWu7vxk+GNt39VFs0S+5+qPz1LlLAYeBXk3Q2Y5i2Mlr521HjZWMpO1CfZBXsi/+fsgd3SDezaq3G5zrOniNEHqN+f+yfYmk2r8+m59UxqORN+RRQjGMcUvfcClrGKNeTo3AM0cIbzyLMyrIwqY61UJRJqhvAllJkPK3+Nmg==</latexit> (17 ⇥ 1) <latexit sha1_base64="F4xwm5t7SFDYPxE276wFOaQcXLA=">AAACbnichVHLSsNAFD2Nr1pfVUEEEYul0lWZVlFxVezGhYs+bBVqkSRONTRNQpIGavEH3IsLQVEQET/DjT/gop8gboQKblx4mwZEi3rDZM6cuefOmTuSoSqWzVjTJ/T09vUP+AcDQ8Mjo2PB8YmCpddMmedlXdXNHUm0uKpoPG8rtsp3DJOLVUnl21Il1d7fdrhpKbq2ZdcNXqqKB5pSVmTRJqq4mdI1J7Su6nJlLxhmMeZGqBvEPRCGF2k9eItd7EOHjBqq4NBgE1YhwqKviDgYDOJKaBBnElLcfY5jBEhboyxOGSKxFfof0KrosRqt2zUtVy3TKSoNk5QhRNgTu2Mt9sju2TP7+LVWw63R9lKnWepoubE3djKde/9XVaXZxuGX6k/PNspYdb0q5N1wmfYt5I7eOTpr5daykcYCu2Yv5P+KNdkD3UBz3uSbDM+eI0APEP/Z7m5QSMTiy7HFTCKcXPKewo8ZzCNK/V5BEhtII+927BQXuPS9ClPCrDDXSRV8nmYS30KIfgJncY3J</latexit> LConv Block <latexit sha1_base64="RuuOEL7N73jZiBP4PDimSQcDG9Y=">AAACcHichVHNLkNBGD29/qp+WmwkFkpDsGjm0iBWEhtLSmlSjdx7TWvS++feaRMaL+AFurBBIiIew8YLWHgEsUNiY+Hr7U0EwTeZmTNnvvPNmRndNYUvGXuIKG3tHZ1d0e5YT29ffzwxMLjlO1XP4DnDMR0vr2s+N4XNc1JIk+ddj2uWbvJtvbLS3N+ucc8Xjr0pD11etLSyLUrC0CRRxSl1IbkjhcX9pDq9m0ixNAsi+ROoIUghjDUncYUd7MGBgSoscNiQhE1o8KkVoILBJa6IOnEeIRHscxwjRtoqZXHK0Iit0FimVSFkbVo3a/qB2qBTTOoeKZOYYPfsmr2wO3bDHtn7r7XqQY2ml0Oa9ZaWu7vxk+GNt39VFs0S+5+qPz1LlLAYeBXk3Q2Y5i2Mlr521HjZWMpO1CfZBXsi/+fsgd3SDezaq3G5zrOniNEHqN+f+yfYmk2r8+m59UxqORN+RRQjGMcUvfcClrGKNeTo3AM0cIbzyLMyrIwqY61UJRJqhvAllJkPK3+Nmg==</latexit> (17 ⇥ 1) <latexit sha1_base64="DbUOObuxpPb/xJsniUsHNWn39/Q=">AAACaHichVFNLwNBGH66vuujxQFxEQ1xat42gjhJXBxpuyVBZHcNJt3ubna3TarxB1wcEScSEfEzXPwBh/4EHCtxcfDudhNB8E5m5pln3uedZ2Z0x5SeT9SIKW3tHZ1d3T3x3r7+gURycKjo2RXXEKphm7a7oWueMKUlVF/6pthwXKGVdVOs66XlYH+9KlxP2lbBrzliu6ztW3JPGprPlFqwS8LaSaYoTWFM/ASZCKQQxaqdvMEWdmHDQAVlCFjwGZvQ4HHbRAYEh7lt1JlzGclwX+AIcdZWOEtwhsZsicd9Xm1GrMXroKYXqg0+xeTusnICU/RIt9SkB7qjJ3r/tVY9rBF4qfGst7TC2Ukcj+bf/lWVefZx8Kn607OPPSyEXiV7d0ImuIXR0lcPT5v5xdxUfZqu6IX9X1KD7vkGVvXVuF4TuQvE+QMy35/7Jyhm05m5NK1lU0uz0Vd0YxyTmOH3nscSVrAKlc+VOMEZzmPPSlIZUcZaqUos0gzjSyiTH568i54=</latexit> Token <latexit sha1_base64="GrpbcoZ6Pi3q4pIPH8LJ6fID8E8=">AAACcHichVFNLwNBGH66vuuruEgclKYiDs1bEcRJOHBE9SOpRna3g4nt7trdNqnGH/AHHFyQiIif4eIPOPgJ4qYSFwdvt5sIDd7JzDzzzPu888yMZhvS9YieQkpbe0dnV3dPuLevf2AwMjScca2yo4u0bhmWk9NUVxjSFGlPeobI2Y5QS5ohstrhamM/WxGOKy1z26vaolBS9025J3XVY6qwYpXNoupUo2uOLO5GYpQgP6KtIBmAGILYsCI32EERFnSUUYKACY+xARUutzySINjMFVBjzmEk/X2BE4RZW+YswRkqs4c87vMqH7Amrxs1XV+t8ykGd4eVUcTpkW6pTg90R8/08Wutml+j4aXKs9bUCnt38HQ09f6vqsSzh4Mv1Z+ePexh0fcq2bvtM41b6E195fisnlraitem6Ipe2P8lPdE938CsvOnXm2LrHGH+gOTP524FmdlEcj5Bm7Ox5bngK7oxhklM83svYBnr2ECazz3CGS5wGXpVRpVxZaKZqoQCzQi+hTLzCbaEjtc=</latexit> Boundary Grid <latexit sha1_base64="/gSmtVp4PpLyMkkTIPQRPP8rcso=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgqilBui6i4Ety47MOqYEtJ4lijaRKStFCLP+AH6MKFDxARP8ONP+DCTxBXouDGhTdpQLSod5iZM2fuuXNmRrF0zXGJHkNSW3tHZ1d3T7i3r39gMDI0vO6YVVsVedXUTXtTkR2ha4bIu5qri03LFnJF0cWGsr/i7W/UhO1oprHm1i1RrMhlQ9vRVNllqpC2zT2hejA6W4rEKEF+RFtBMgAxBJE2I9coYBsmVFRRgYABl7EOGQ63LSRBsJgrosGczUjz9wUOEWZtlbMEZ8jM7vNY5tVWwBq89mo6vlrlU3TuNiujiNMD3dAr3dMtPdHHr7Uafg3PS51npakVVmnwaCz3/q+qwrOL3S/Vn55d7GDR96qxd8tnvFuoTX3t4OQ1t5SNN6bokp7Z/wU90h3fwKi9qVcZkT1FmD8g+fO5W8F6KpGcT1AmFVueC76iG+OYxDS/9wKWsYo08nyuhWOc4Tz0Io1KE1K0mSqFAs0IvoU08wmJoY5L</latexit> Projection + <latexit sha1_base64="diJIXgkEfx0Dmotti7JEaSD4fhM=">AAACdHichVHLSsNAFD2N7/po1Y2gi2KpCEK5FVFxVXDjslqrgkpJ4lQH0yQk04IWf8AfcNGVYhHxM9z4Ay76CeKyohsX3qYBUVFvmMyZM/fcOTPXcC3pK6JmROvq7unt6x+IDg4Nj8Tio2NbvlPxTFEwHcvxdgzdF5a0RUFJZYkd1xN62bDEtnG82t7frgrPl469qU5csV/WD21ZkqaumCrGY4bU/cRcIu+UlGtV/GI8SWkKIvETZEKQRBg5J36DPRzAgYkKyhCwoRhb0OHzt4sMCC5z+6gx5zGSwb7AGaKsrXCW4Ayd2WP+H/JqN2RtXrdr+oHa5FMsHh4rE0jRI91Six7ojp7o/ddataBG28sJz0ZHK9xi7Hwi//avqsyzwtGn6k/PCiUsB14le3cDpn0Ls6Ovnl608isbqdoMXdEz+7+kJt3zDezqi9lYFxt1RLkBme/P/RNszaczi2lan09mF8JW9GMS05jl915CFmvIoRD0pI5rNCKv2pSW1FKdVC0SasbxJbT0B43Jj5w=</latexit> bias + Softplus <latexit sha1_base64="TiEUoUwOnomu0d5ZVAJ0QQkDp2Y=">AAACanichVFNLwNBGH66vqo+WlyIS6OIU/O2EcSpiYsjqq2Eptld05p0u7vZ3VZo/AE3JwknEhHxM1z8AQc/QbhV4uLg7XYTQfBOZuaZZ97nnWdmNNuQrkf0GFK6unt6+8L9kYHBoeFobGQ071p1Rxc53TIsZ0tTXWFIU+Q86Rliy3aEWtMMUdCqK+39QkM4rrTMTe/AFsWaWjFlWeqqx1QhHc/uS3evFEtQkvyI/wSpACQQxJoVu8YOdmFBRx01CJjwGBtQ4XLbRgoEm7kimsw5jKS/L3CECGvrnCU4Q2W2ymOFV9sBa/K6XdP11TqfYnB3WBnHDD3QDbXonm7pid5/rdX0a7S9HPCsdbTCLkWPx7Nv/6pqPHvY+1T96dlDGUu+V8nebZ9p30Lv6BuHp63s8sZMc5Yu6Zn9X9Aj3fENzMarfrUuNs4R4Q9IfX/unyCfTqYWkrSeTmTmg68IYxJTmOP3XkQGq1hDznd3gjOch16UUWVCmeykKqFAM4YvoUx/AKmHjBE=</latexit> 2 Swish <latexit sha1_base64="Tfz6l1A1ITSH1dLwQ9y5V9Bv/iA=">AAACaHichVFNLwNBGH66vqq+igPiIhri1LwVQZwaLo5t2ZIgsrsGk253N7vbJtX4Ay6OiBOJiPgZLv6AQ38CjiQuDt7dbiII3snMPPPM+7zzzIzumNLziRoxpaW1rb0j3pno6u7p7Uv2DxQ9u+IaQjVs03bXdc0TprSE6kvfFOuOK7Syboo1vbQU7K9VhetJ21r1a47YKmt7ltyVhuYzpS6atlHaTqYoTWGM/QSZCKQQRc5OXmMTO7BhoIIyBCz4jE1o8LhtIAOCw9wW6sy5jGS4L3CIBGsrnCU4Q2O2xOMerzYi1uJ1UNML1QafYnJ3WTmGCXqgG3qhe7qlR3r/tVY9rBF4qfGsN7XC2e47Gl55+1dV5tnH/qfqT88+djEfepXs3QmZ4BZGU189OHlZWShM1Cfpkp7Z/wU16I5vYFVfjau8KJwjwR+Q+f7cP0FxOp2ZTVN+OpWdib4ijlGMY4rfew5ZLCMHlc+VOMYpzmJPSlIZUkaaqUos0gziSyjjH3Jxi4g=</latexit> Block <latexit sha1_base64="TiEUoUwOnomu0d5ZVAJ0QQkDp2Y=">AAACanichVFNLwNBGH66vqo+WlyIS6OIU/O2EcSpiYsjqq2Eptld05p0u7vZ3VZo/AE3JwknEhHxM1z8AQc/QbhV4uLg7XYTQfBOZuaZZ97nnWdmNNuQrkf0GFK6unt6+8L9kYHBoeFobGQ071p1Rxc53TIsZ0tTXWFIU+Q86Rliy3aEWtMMUdCqK+39QkM4rrTMTe/AFsWaWjFlWeqqx1QhHc/uS3evFEtQkvyI/wSpACQQxJoVu8YOdmFBRx01CJjwGBtQ4XLbRgoEm7kimsw5jKS/L3CECGvrnCU4Q2W2ymOFV9sBa/K6XdP11TqfYnB3WBnHDD3QDbXonm7pid5/rdX0a7S9HPCsdbTCLkWPx7Nv/6pqPHvY+1T96dlDGUu+V8nebZ9p30Lv6BuHp63s8sZMc5Yu6Zn9X9Aj3fENzMarfrUuNs4R4Q9IfX/unyCfTqYWkrSeTmTmg68IYxJTmOP3XkQGq1hDznd3gjOch16UUWVCmeykKqFAM4YvoUx/AKmHjBE=</latexit> 2 Swish <latexit sha1_base64="Tfz6l1A1ITSH1dLwQ9y5V9Bv/iA=">AAACaHichVFNLwNBGH66vqq+igPiIhri1LwVQZwaLo5t2ZIgsrsGk253N7vbJtX4Ay6OiBOJiPgZLv6AQ38CjiQuDt7dbiII3snMPPPM+7zzzIzumNLziRoxpaW1rb0j3pno6u7p7Uv2DxQ9u+IaQjVs03bXdc0TprSE6kvfFOuOK7Syboo1vbQU7K9VhetJ21r1a47YKmt7ltyVhuYzpS6atlHaTqYoTWGM/QSZCKQQRc5OXmMTO7BhoIIyBCz4jE1o8LhtIAOCw9wW6sy5jGS4L3CIBGsrnCU4Q2O2xOMerzYi1uJ1UNML1QafYnJ3WTmGCXqgG3qhe7qlR3r/tVY9rBF4qfGsN7XC2e47Gl55+1dV5tnH/qfqT88+djEfepXs3QmZ4BZGU189OHlZWShM1Cfpkp7Z/wU16I5vYFVfjau8KJwjwR+Q+f7cP0FxOp2ZTVN+OpWdib4ijlGMY4rfew5ZLCMHlc+VOMYpzmJPSlIZUkaaqUos0gziSyjjH3Jxi4g=</latexit> Block <latexit sha1_base64="/gSmtVp4PpLyMkkTIPQRPP8rcso=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgqilBui6i4Ety47MOqYEtJ4lijaRKStFCLP+AH6MKFDxARP8ONP+DCTxBXouDGhTdpQLSod5iZM2fuuXNmRrF0zXGJHkNSW3tHZ1d3T7i3r39gMDI0vO6YVVsVedXUTXtTkR2ha4bIu5qri03LFnJF0cWGsr/i7W/UhO1oprHm1i1RrMhlQ9vRVNllqpC2zT2hejA6W4rEKEF+RFtBMgAxBJE2I9coYBsmVFRRgYABl7EOGQ63LSRBsJgrosGczUjz9wUOEWZtlbMEZ8jM7vNY5tVWwBq89mo6vlrlU3TuNiujiNMD3dAr3dMtPdHHr7Uafg3PS51npakVVmnwaCz3/q+qwrOL3S/Vn55d7GDR96qxd8tnvFuoTX3t4OQ1t5SNN6bokp7Z/wU90h3fwKi9qVcZkT1FmD8g+fO5W8F6KpGcT1AmFVueC76iG+OYxDS/9wKWsYo08nyuhWOc4Tz0Io1KE1K0mSqFAs0IvoU08wmJoY5L</latexit> Projection + <latexit sha1_base64="uw577xxHdhTBbTIN30O7lNeyTiI=">AAACZ3ichVHLSsNAFD2Nr1ofrQpScKMWxVW5qaLiquDGZatWBRVJ4miHpklI0kIt/oALtxVcKYiIn+HGH3DhJ4hLBTcuvEkDoqLeYWbOnLnnzpkZ3TGl5xM9xpSOzq7unnhvoq9/YDCZGhre8Oyaa4iSYZu2u6VrnjClJUq+9E2x5bhCq+qm2NQry8H+Zl24nrStdb/hiN2qdmjJA2lofkDpUvP2UhnKUhjjP4EagQyiKNipa+xgHzYM1FCFgAWfsQkNHrdtqCA4zO2iyZzLSIb7AsdIsLbGWYIzNGYrPB7yajtiLV4HNb1QbfApJneXleOYoge6oRe6p1t6ovdfazXDGoGXBs96WyucveRJeu3tX1WVZx/lT9Wfnn0cYDH0Ktm7EzLBLYy2vn7UellbWp1qTtMlPbP/C3qkO76BVX81ropi9RwJ/gD1+3P/BBu5rDqfnS3mMvm56CviGMMkZvi9F5DHCgoo8bllnKKFs9iTklRGlXQ7VYlFmhF8CWXiA7S+izU=</latexit> bias <latexit sha1_base64="kbvus8QJBEvdLd+jbipFAU4JrvI=">AAACf3ichVFNLyxBFD3TvofHYCNsOibeYzO5jfhaSVhY+hokRibdrVDRX+mumWAisfYHLKxIELHgP9j4AxZ+gliS2Fi409OJvCfvvVupqlOn7rl1qsoKHBkpoqeUVlff0NjU3JJubfvR3pHp7FqJ/FJoi7ztO364ZpmRcKQn8koqR6wFoTBdyxGr1u5MdX+1LMJI+t6y2g/Ehmtue3JL2qZiqpjpLSixpyozvlc2ZvXDwRG9oKQrIt0YKmaylKM49O/ASEAWScz7mSsUsAkfNkpwIeBBMXZgIuK2DgOEgLkNVJgLGcl4X+AQadaWOEtwhsnsLo/bvFpPWI/X1ZpRrLb5FId7yEodA/RI1/RKD3RDz/Tx11qVuEbVyz7PVk0rgmLHcc/S+39VLs8KO1+qf3pW2MJE7FWy9yBmqrewa/rywcnr0tTiQOUnndML+z+jJ7rnG3jlN/tiQSyeIs0fYPz53N/BynDOGMuNLIxmp0eTr2hGH/oxyO89jmnMYR55PvcIl7jFnZbSfmk5jWqpWirRdOO30CY/AfSZkl0=</latexit> Conv1D (3 ⇥ 1) <latexit sha1_base64="kbvus8QJBEvdLd+jbipFAU4JrvI=">AAACf3ichVFNLyxBFD3TvofHYCNsOibeYzO5jfhaSVhY+hokRibdrVDRX+mumWAisfYHLKxIELHgP9j4AxZ+gliS2Fi409OJvCfvvVupqlOn7rl1qsoKHBkpoqeUVlff0NjU3JJubfvR3pHp7FqJ/FJoi7ztO364ZpmRcKQn8koqR6wFoTBdyxGr1u5MdX+1LMJI+t6y2g/Ehmtue3JL2qZiqpjpLSixpyozvlc2ZvXDwRG9oKQrIt0YKmaylKM49O/ASEAWScz7mSsUsAkfNkpwIeBBMXZgIuK2DgOEgLkNVJgLGcl4X+AQadaWOEtwhsnsLo/bvFpPWI/X1ZpRrLb5FId7yEodA/RI1/RKD3RDz/Tx11qVuEbVyz7PVk0rgmLHcc/S+39VLs8KO1+qf3pW2MJE7FWy9yBmqrewa/rywcnr0tTiQOUnndML+z+jJ7rnG3jlN/tiQSyeIs0fYPz53N/BynDOGMuNLIxmp0eTr2hGH/oxyO89jmnMYR55PvcIl7jFnZbSfmk5jWqpWirRdOO30CY/AfSZkl0=</latexit> Conv1D (3 ⇥ 1) <latexit sha1_base64="/gSmtVp4PpLyMkkTIPQRPP8rcso=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgqilBui6i4Ety47MOqYEtJ4lijaRKStFCLP+AH6MKFDxARP8ONP+DCTxBXouDGhTdpQLSod5iZM2fuuXNmRrF0zXGJHkNSW3tHZ1d3T7i3r39gMDI0vO6YVVsVedXUTXtTkR2ha4bIu5qri03LFnJF0cWGsr/i7W/UhO1oprHm1i1RrMhlQ9vRVNllqpC2zT2hejA6W4rEKEF+RFtBMgAxBJE2I9coYBsmVFRRgYABl7EOGQ63LSRBsJgrosGczUjz9wUOEWZtlbMEZ8jM7vNY5tVWwBq89mo6vlrlU3TuNiujiNMD3dAr3dMtPdHHr7Uafg3PS51npakVVmnwaCz3/q+qwrOL3S/Vn55d7GDR96qxd8tnvFuoTX3t4OQ1t5SNN6bokp7Z/wU90h3fwKi9qVcZkT1FmD8g+fO5W8F6KpGcT1AmFVueC76iG+OYxDS/9wKWsYo08nyuhWOc4Tz0Io1KE1K0mSqFAs0IvoU08wmJoY5L</latexit> Projection + <latexit sha1_base64="uw577xxHdhTBbTIN30O7lNeyTiI=">AAACZ3ichVHLSsNAFD2Nr1ofrQpScKMWxVW5qaLiquDGZatWBRVJ4miHpklI0kIt/oALtxVcKYiIn+HGH3DhJ4hLBTcuvEkDoqLeYWbOnLnnzpkZ3TGl5xM9xpSOzq7unnhvoq9/YDCZGhre8Oyaa4iSYZu2u6VrnjClJUq+9E2x5bhCq+qm2NQry8H+Zl24nrStdb/hiN2qdmjJA2lofkDpUvP2UhnKUhjjP4EagQyiKNipa+xgHzYM1FCFgAWfsQkNHrdtqCA4zO2iyZzLSIb7AsdIsLbGWYIzNGYrPB7yajtiLV4HNb1QbfApJneXleOYoge6oRe6p1t6ovdfazXDGoGXBs96WyucveRJeu3tX1WVZx/lT9Wfnn0cYDH0Ktm7EzLBLYy2vn7UellbWp1qTtMlPbP/C3qkO76BVX81ropi9RwJ/gD1+3P/BBu5rDqfnS3mMvm56CviGMMkZvi9F5DHCgoo8bllnKKFs9iTklRGlXQ7VYlFmhF8CWXiA7S+izU=</latexit> bias <latexit sha1_base64="/gSmtVp4PpLyMkkTIPQRPP8rcso=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgqilBui6i4Ety47MOqYEtJ4lijaRKStFCLP+AH6MKFDxARP8ONP+DCTxBXouDGhTdpQLSod5iZM2fuuXNmRrF0zXGJHkNSW3tHZ1d3T7i3r39gMDI0vO6YVVsVedXUTXtTkR2ha4bIu5qri03LFnJF0cWGsr/i7W/UhO1oprHm1i1RrMhlQ9vRVNllqpC2zT2hejA6W4rEKEF+RFtBMgAxBJE2I9coYBsmVFRRgYABl7EOGQ63LSRBsJgrosGczUjz9wUOEWZtlbMEZ8jM7vNY5tVWwBq89mo6vlrlU3TuNiujiNMD3dAr3dMtPdHHr7Uafg3PS51npakVVmnwaCz3/q+qwrOL3S/Vn55d7GDR96qxd8tnvFuoTX3t4OQ1t5SNN6bokp7Z/wU90h3fwKi9qVcZkT1FmD8g+fO5W8F6KpGcT1AmFVueC76iG+OYxDS/9wKWsYo08nyuhWOc4Tz0Io1KE1K0mSqFAs0IvoU08wmJoY5L</latexit> Projection + <latexit sha1_base64="uw577xxHdhTBbTIN30O7lNeyTiI=">AAACZ3ichVHLSsNAFD2Nr1ofrQpScKMWxVW5qaLiquDGZatWBRVJ4miHpklI0kIt/oALtxVcKYiIn+HGH3DhJ4hLBTcuvEkDoqLeYWbOnLnnzpkZ3TGl5xM9xpSOzq7unnhvoq9/YDCZGhre8Oyaa4iSYZu2u6VrnjClJUq+9E2x5bhCq+qm2NQry8H+Zl24nrStdb/hiN2qdmjJA2lofkDpUvP2UhnKUhjjP4EagQyiKNipa+xgHzYM1FCFgAWfsQkNHrdtqCA4zO2iyZzLSIb7AsdIsLbGWYIzNGYrPB7yajtiLV4HNb1QbfApJneXleOYoge6oRe6p1t6ovdfazXDGoGXBs96WyucveRJeu3tX1WVZx/lT9Wfnn0cYDH0Ktm7EzLBLYy2vn7UellbWp1qTtMlPbP/C3qkO76BVX81ropi9RwJ/gD1+3P/BBu5rDqfnS3mMvm56CviGMMkZvi9F5DHCgoo8bllnKKFs9iTklRGlXQ7VYlFmhF8CWXiA7S+izU=</latexit> bias <latexit sha1_base64="/gSmtVp4PpLyMkkTIPQRPP8rcso=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgqilBui6i4Ety47MOqYEtJ4lijaRKStFCLP+AH6MKFDxARP8ONP+DCTxBXouDGhTdpQLSod5iZM2fuuXNmRrF0zXGJHkNSW3tHZ1d3T7i3r39gMDI0vO6YVVsVedXUTXtTkR2ha4bIu5qri03LFnJF0cWGsr/i7W/UhO1oprHm1i1RrMhlQ9vRVNllqpC2zT2hejA6W4rEKEF+RFtBMgAxBJE2I9coYBsmVFRRgYABl7EOGQ63LSRBsJgrosGczUjz9wUOEWZtlbMEZ8jM7vNY5tVWwBq89mo6vlrlU3TuNiujiNMD3dAr3dMtPdHHr7Uafg3PS51npakVVmnwaCz3/q+qwrOL3S/Vn55d7GDR96qxd8tnvFuoTX3t4OQ1t5SNN6bokp7Z/wU90h3fwKi9qVcZkT1FmD8g+fO5W8F6KpGcT1AmFVueC76iG+OYxDS/9wKWsYo08nyuhWOc4Tz0Io1KE1K0mSqFAs0IvoU08wmJoY5L</latexit> Projection + <latexit sha1_base64="uw577xxHdhTBbTIN30O7lNeyTiI=">AAACZ3ichVHLSsNAFD2Nr1ofrQpScKMWxVW5qaLiquDGZatWBRVJ4miHpklI0kIt/oALtxVcKYiIn+HGH3DhJ4hLBTcuvEkDoqLeYWbOnLnnzpkZ3TGl5xM9xpSOzq7unnhvoq9/YDCZGhre8Oyaa4iSYZu2u6VrnjClJUq+9E2x5bhCq+qm2NQry8H+Zl24nrStdb/hiN2qdmjJA2lofkDpUvP2UhnKUhjjP4EagQyiKNipa+xgHzYM1FCFgAWfsQkNHrdtqCA4zO2iyZzLSIb7AsdIsLbGWYIzNGYrPB7yajtiLV4HNb1QbfApJneXleOYoge6oRe6p1t6ovdfazXDGoGXBs96WyucveRJeu3tX1WVZx/lT9Wfnn0cYDH0Ktm7EzLBLYy2vn7UellbWp1qTtMlPbP/C3qkO76BVX81ropi9RwJ/gD1+3P/BBu5rDqfnS3mMvm56CviGMMkZvi9F5DHCgoo8bllnKKFs9iTklRGlXQ7VYlFmhF8CWXiA7S+izU=</latexit> bias <latexit sha1_base64="/gSmtVp4PpLyMkkTIPQRPP8rcso=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgqilBui6i4Ety47MOqYEtJ4lijaRKStFCLP+AH6MKFDxARP8ONP+DCTxBXouDGhTdpQLSod5iZM2fuuXNmRrF0zXGJHkNSW3tHZ1d3T7i3r39gMDI0vO6YVVsVedXUTXtTkR2ha4bIu5qri03LFnJF0cWGsr/i7W/UhO1oprHm1i1RrMhlQ9vRVNllqpC2zT2hejA6W4rEKEF+RFtBMgAxBJE2I9coYBsmVFRRgYABl7EOGQ63LSRBsJgrosGczUjz9wUOEWZtlbMEZ8jM7vNY5tVWwBq89mo6vlrlU3TuNiujiNMD3dAr3dMtPdHHr7Uafg3PS51npakVVmnwaCz3/q+qwrOL3S/Vn55d7GDR96qxd8tnvFuoTX3t4OQ1t5SNN6bokp7Z/wU90h3fwKi9qVcZkT1FmD8g+fO5W8F6KpGcT1AmFVueC76iG+OYxDS/9wKWsYo08nyuhWOc4Tz0Io1KE1K0mSqFAs0IvoU08wmJoY5L</latexit> Projection + <latexit sha1_base64="uw577xxHdhTBbTIN30O7lNeyTiI=">AAACZ3ichVHLSsNAFD2Nr1ofrQpScKMWxVW5qaLiquDGZatWBRVJ4miHpklI0kIt/oALtxVcKYiIn+HGH3DhJ4hLBTcuvEkDoqLeYWbOnLnnzpkZ3TGl5xM9xpSOzq7unnhvoq9/YDCZGhre8Oyaa4iSYZu2u6VrnjClJUq+9E2x5bhCq+qm2NQry8H+Zl24nrStdb/hiN2qdmjJA2lofkDpUvP2UhnKUhjjP4EagQyiKNipa+xgHzYM1FCFgAWfsQkNHrdtqCA4zO2iyZzLSIb7AsdIsLbGWYIzNGYrPB7yajtiLV4HNb1QbfApJneXleOYoge6oRe6p1t6ovdfazXDGoGXBs96WyucveRJeu3tX1WVZx/lT9Wfnn0cYDH0Ktm7EzLBLYy2vn7UellbWp1qTtMlPbP/C3qkO76BVX81ropi9RwJ/gD1+3P/BBu5rDqfnS3mMvm56CviGMMkZvi9F5DHCgoo8bllnKKFs9iTklRGlXQ7VYlFmhF8CWXiA7S+izU=</latexit> bias <latexit sha1_base64="/gSmtVp4PpLyMkkTIPQRPP8rcso=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgqilBui6i4Ety47MOqYEtJ4lijaRKStFCLP+AH6MKFDxARP8ONP+DCTxBXouDGhTdpQLSod5iZM2fuuXNmRrF0zXGJHkNSW3tHZ1d3T7i3r39gMDI0vO6YVVsVedXUTXtTkR2ha4bIu5qri03LFnJF0cWGsr/i7W/UhO1oprHm1i1RrMhlQ9vRVNllqpC2zT2hejA6W4rEKEF+RFtBMgAxBJE2I9coYBsmVFRRgYABl7EOGQ63LSRBsJgrosGczUjz9wUOEWZtlbMEZ8jM7vNY5tVWwBq89mo6vlrlU3TuNiujiNMD3dAr3dMtPdHHr7Uafg3PS51npakVVmnwaCz3/q+qwrOL3S/Vn55d7GDR96qxd8tnvFuoTX3t4OQ1t5SNN6bokp7Z/wU90h3fwKi9qVcZkT1FmD8g+fO5W8F6KpGcT1AmFVueC76iG+OYxDS/9wKWsYo08nyuhWOc4Tz0Io1KE1K0mSqFAs0IvoU08wmJoY5L</latexit> Projection + <latexit sha1_base64="uw577xxHdhTBbTIN30O7lNeyTiI=">AAACZ3ichVHLSsNAFD2Nr1ofrQpScKMWxVW5qaLiquDGZatWBRVJ4miHpklI0kIt/oALtxVcKYiIn+HGH3DhJ4hLBTcuvEkDoqLeYWbOnLnnzpkZ3TGl5xM9xpSOzq7unnhvoq9/YDCZGhre8Oyaa4iSYZu2u6VrnjClJUq+9E2x5bhCq+qm2NQry8H+Zl24nrStdb/hiN2qdmjJA2lofkDpUvP2UhnKUhjjP4EagQyiKNipa+xgHzYM1FCFgAWfsQkNHrdtqCA4zO2iyZzLSIb7AsdIsLbGWYIzNGYrPB7yajtiLV4HNb1QbfApJneXleOYoge6oRe6p1t6ovdfazXDGoGXBs96WyucveRJeu3tX1WVZx/lT9Wfnn0cYDH0Ktm7EzLBLYy2vn7UellbWp1qTtMlPbP/C3qkO76BVX81ropi9RwJ/gD1+3P/BBu5rDqfnS3mMvm56CviGMMkZvi9F5DHCgoo8bllnKKFs9iTklRGlXQ7VYlFmhF8CWXiA7S+izU=</latexit> bias <latexit sha1_base64="/gSmtVp4PpLyMkkTIPQRPP8rcso=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgqilBui6i4Ety47MOqYEtJ4lijaRKStFCLP+AH6MKFDxARP8ONP+DCTxBXouDGhTdpQLSod5iZM2fuuXNmRrF0zXGJHkNSW3tHZ1d3T7i3r39gMDI0vO6YVVsVedXUTXtTkR2ha4bIu5qri03LFnJF0cWGsr/i7W/UhO1oprHm1i1RrMhlQ9vRVNllqpC2zT2hejA6W4rEKEF+RFtBMgAxBJE2I9coYBsmVFRRgYABl7EOGQ63LSRBsJgrosGczUjz9wUOEWZtlbMEZ8jM7vNY5tVWwBq89mo6vlrlU3TuNiujiNMD3dAr3dMtPdHHr7Uafg3PS51npakVVmnwaCz3/q+qwrOL3S/Vn55d7GDR96qxd8tnvFuoTX3t4OQ1t5SNN6bokp7Z/wU90h3fwKi9qVcZkT1FmD8g+fO5W8F6KpGcT1AmFVueC76iG+OYxDS/9wKWsYo08nyuhWOc4Tz0Io1KE1K0mSqFAs0IvoU08wmJoY5L</latexit> Projection + <latexit sha1_base64="uw577xxHdhTBbTIN30O7lNeyTiI=">AAACZ3ichVHLSsNAFD2Nr1ofrQpScKMWxVW5qaLiquDGZatWBRVJ4miHpklI0kIt/oALtxVcKYiIn+HGH3DhJ4hLBTcuvEkDoqLeYWbOnLnnzpkZ3TGl5xM9xpSOzq7unnhvoq9/YDCZGhre8Oyaa4iSYZu2u6VrnjClJUq+9E2x5bhCq+qm2NQry8H+Zl24nrStdb/hiN2qdmjJA2lofkDpUvP2UhnKUhjjP4EagQyiKNipa+xgHzYM1FCFgAWfsQkNHrdtqCA4zO2iyZzLSIb7AsdIsLbGWYIzNGYrPB7yajtiLV4HNb1QbfApJneXleOYoge6oRe6p1t6ovdfazXDGoGXBs96WyucveRJeu3tX1WVZx/lT9Wfnn0cYDH0Ktm7EzLBLYy2vn7UellbWp1qTtMlPbP/C3qkO76BVX81ropi9RwJ/gD1+3P/BBu5rDqfnS3mMvm56CviGMMkZvi9F5DHCgoo8bllnKKFs9iTklRGlXQ7VYlFmhF8CWXiA7S+izU=</latexit> bias <latexit sha1_base64="D5566oBMndcdnPT9qWf93u0+azM=">AAACbHichVHLSgMxFD0dX7W+6mMhFEEsFVclo6LiSnDjslqrlVpkZho1OC9m0kIt/oBbFy7UhYKI+Blu/AEXfoIIbhTcuPDOdEBU1BuSnJzcc3OS6K4pfMnYQ0xpaW1r74h3Jrq6e3r7kv0Da75T9QxeMBzT8Yq65nNT2LwghTR50fW4ZukmX9f3FoP99Rr3fOHYq7Lu8rKl7dhiWxiaJGoj5/GKMCSvbCXTLMvCGP0J1AikEUXOSV5hExU4MFCFBQ4bkrAJDT61ElQwuMSV0SDOIyTCfY4DJEhbpSxOGRqxezTu0KoUsTatg5p+qDboFJO6R8pRZNg9u2Yv7I7dsEf2/mutRlgj8FKnWW9qubvVdzicf/tXZdEssfup+tOzxDbmQq+CvLshE9zCaOpr+8cv+fmVTGOcXbAn8n/OHtgt3cCuvRqXy3zlBAn6APX7c/8Ea5NZdSY7tTyZXpiOviKOFMYwQe89iwUsIYcCnWvhCKc4iz0rQ0pKGWmmKrFIM4gvoYx/AGXMjVw=</latexit> Predicted <latexit sha1_base64="p5PXxr+3VGJdGEsO3+KKUbsKu/s=">AAACdHichVG7SgNBFD1Z3/GRqI2ghbhEbAyTKCpWgo1lHkYFlbC7jnHJvpidBGLwB/wBCytFEfEzbPwBi3yCWEa0sfDuZkFU1LvMzpkz99w5M1f3LNOXjLViSld3T29f/0B8cGh4JJEcHdvy3ZoweMlwLVfs6JrPLdPhJWlKi+94gmu2bvFtvboe7G/XufBN19mUDY/v21rFMQ9NQ5NElZMJm1vzvscNKdyK0OxyUmVpFsb0T5CJgIoocm7yBns4gAsDNdjgcCAJW9Dg07eLDBg84vbRJE4QMsN9jhPESVujLE4ZGrFV+ldotRuxDq2Dmn6oNugUi4Yg5TRS7JHdsjZ7YHfsib3/WqsZ1gi8NGjWO1rulROnE8W3f1U2zRJHn6o/PUscYiX0apJ3L2SCWxgdff34rF1cLaSas+ySPZP/C9Zi93QDp/5iXOd54RxxakDm+3P/BFvZdGYpvZDPqmuLUSv6MYkZzNF7L2MNG8ihFPbkHFe4jr0qU4qqpDqpSizSjONLKOkP5RyQRw==</latexit> mel-spectrogram <latexit sha1_base64="D5566oBMndcdnPT9qWf93u0+azM=">AAACbHichVHLSgMxFD0dX7W+6mMhFEEsFVclo6LiSnDjslqrlVpkZho1OC9m0kIt/oBbFy7UhYKI+Blu/AEXfoIIbhTcuPDOdEBU1BuSnJzcc3OS6K4pfMnYQ0xpaW1r74h3Jrq6e3r7kv0Da75T9QxeMBzT8Yq65nNT2LwghTR50fW4ZukmX9f3FoP99Rr3fOHYq7Lu8rKl7dhiWxiaJGoj5/GKMCSvbCXTLMvCGP0J1AikEUXOSV5hExU4MFCFBQ4bkrAJDT61ElQwuMSV0SDOIyTCfY4DJEhbpSxOGRqxezTu0KoUsTatg5p+qDboFJO6R8pRZNg9u2Yv7I7dsEf2/mutRlgj8FKnWW9qubvVdzicf/tXZdEssfup+tOzxDbmQq+CvLshE9zCaOpr+8cv+fmVTGOcXbAn8n/OHtgt3cCuvRqXy3zlBAn6APX7c/8Ea5NZdSY7tTyZXpiOviKOFMYwQe89iwUsIYcCnWvhCKc4iz0rQ0pKGWmmKrFIM4gvoYx/AGXMjVw=</latexit> Predicted <latexit sha1_base64="p5PXxr+3VGJdGEsO3+KKUbsKu/s=">AAACdHichVG7SgNBFD1Z3/GRqI2ghbhEbAyTKCpWgo1lHkYFlbC7jnHJvpidBGLwB/wBCytFEfEzbPwBi3yCWEa0sfDuZkFU1LvMzpkz99w5M1f3LNOXjLViSld3T29f/0B8cGh4JJEcHdvy3ZoweMlwLVfs6JrPLdPhJWlKi+94gmu2bvFtvboe7G/XufBN19mUDY/v21rFMQ9NQ5NElZMJm1vzvscNKdyK0OxyUmVpFsb0T5CJgIoocm7yBns4gAsDNdjgcCAJW9Dg07eLDBg84vbRJE4QMsN9jhPESVujLE4ZGrFV+ldotRuxDq2Dmn6oNugUi4Yg5TRS7JHdsjZ7YHfsib3/WqsZ1gi8NGjWO1rulROnE8W3f1U2zRJHn6o/PUscYiX0apJ3L2SCWxgdff34rF1cLaSas+ySPZP/C9Zi93QDp/5iXOd54RxxakDm+3P/BFvZdGYpvZDPqmuLUSv6MYkZzNF7L2MNG8ihFPbkHFe4jr0qU4qqpDqpSizSjONLKOkP5RyQRw==</latexit> mel-spectrogram <latexit sha1_base64="D5566oBMndcdnPT9qWf93u0+azM=">AAACbHichVHLSgMxFD0dX7W+6mMhFEEsFVclo6LiSnDjslqrlVpkZho1OC9m0kIt/oBbFy7UhYKI+Blu/AEXfoIIbhTcuPDOdEBU1BuSnJzcc3OS6K4pfMnYQ0xpaW1r74h3Jrq6e3r7kv0Da75T9QxeMBzT8Yq65nNT2LwghTR50fW4ZukmX9f3FoP99Rr3fOHYq7Lu8rKl7dhiWxiaJGoj5/GKMCSvbCXTLMvCGP0J1AikEUXOSV5hExU4MFCFBQ4bkrAJDT61ElQwuMSV0SDOIyTCfY4DJEhbpSxOGRqxezTu0KoUsTatg5p+qDboFJO6R8pRZNg9u2Yv7I7dsEf2/mutRlgj8FKnWW9qubvVdzicf/tXZdEssfup+tOzxDbmQq+CvLshE9zCaOpr+8cv+fmVTGOcXbAn8n/OHtgt3cCuvRqXy3zlBAn6APX7c/8Ea5NZdSY7tTyZXpiOviKOFMYwQe89iwUsIYcCnWvhCKc4iz0rQ0pKGWmmKrFIM4gvoYx/AGXMjVw=</latexit> Predicted <latexit sha1_base64="p5PXxr+3VGJdGEsO3+KKUbsKu/s=">AAACdHichVG7SgNBFD1Z3/GRqI2ghbhEbAyTKCpWgo1lHkYFlbC7jnHJvpidBGLwB/wBCytFEfEzbPwBi3yCWEa0sfDuZkFU1LvMzpkz99w5M1f3LNOXjLViSld3T29f/0B8cGh4JJEcHdvy3ZoweMlwLVfs6JrPLdPhJWlKi+94gmu2bvFtvboe7G/XufBN19mUDY/v21rFMQ9NQ5NElZMJm1vzvscNKdyK0OxyUmVpFsb0T5CJgIoocm7yBns4gAsDNdjgcCAJW9Dg07eLDBg84vbRJE4QMsN9jhPESVujLE4ZGrFV+ldotRuxDq2Dmn6oNugUi4Yg5TRS7JHdsjZ7YHfsib3/WqsZ1gi8NGjWO1rulROnE8W3f1U2zRJHn6o/PUscYiX0apJ3L2SCWxgdff34rF1cLaSas+ySPZP/C9Zi93QDp/5iXOd54RxxakDm+3P/BFvZdGYpvZDPqmuLUSv6MYkZzNF7L2MNG8ihFPbkHFe4jr0qU4qqpDqpSizSjONLKOkP5RyQRw==</latexit> mel-spectrogram <latexit sha1_base64="D5566oBMndcdnPT9qWf93u0+azM=">AAACbHichVHLSgMxFD0dX7W+6mMhFEEsFVclo6LiSnDjslqrlVpkZho1OC9m0kIt/oBbFy7UhYKI+Blu/AEXfoIIbhTcuPDOdEBU1BuSnJzcc3OS6K4pfMnYQ0xpaW1r74h3Jrq6e3r7kv0Da75T9QxeMBzT8Yq65nNT2LwghTR50fW4ZukmX9f3FoP99Rr3fOHYq7Lu8rKl7dhiWxiaJGoj5/GKMCSvbCXTLMvCGP0J1AikEUXOSV5hExU4MFCFBQ4bkrAJDT61ElQwuMSV0SDOIyTCfY4DJEhbpSxOGRqxezTu0KoUsTatg5p+qDboFJO6R8pRZNg9u2Yv7I7dsEf2/mutRlgj8FKnWW9qubvVdzicf/tXZdEssfup+tOzxDbmQq+CvLshE9zCaOpr+8cv+fmVTGOcXbAn8n/OHtgt3cCuvRqXy3zlBAn6APX7c/8Ea5NZdSY7tTyZXpiOviKOFMYwQe89iwUsIYcCnWvhCKc4iz0rQ0pKGWmmKrFIM4gvoYx/AGXMjVw=</latexit> Predicted <latexit sha1_base64="p5PXxr+3VGJdGEsO3+KKUbsKu/s=">AAACdHichVG7SgNBFD1Z3/GRqI2ghbhEbAyTKCpWgo1lHkYFlbC7jnHJvpidBGLwB/wBCytFEfEzbPwBi3yCWEa0sfDuZkFU1LvMzpkz99w5M1f3LNOXjLViSld3T29f/0B8cGh4JJEcHdvy3ZoweMlwLVfs6JrPLdPhJWlKi+94gmu2bvFtvboe7G/XufBN19mUDY/v21rFMQ9NQ5NElZMJm1vzvscNKdyK0OxyUmVpFsb0T5CJgIoocm7yBns4gAsDNdjgcCAJW9Dg07eLDBg84vbRJE4QMsN9jhPESVujLE4ZGrFV+ldotRuxDq2Dmn6oNugUi4Yg5TRS7JHdsjZ7YHfsib3/WqsZ1gi8NGjWO1rulROnE8W3f1U2zRJHn6o/PUscYiX0apJ3L2SCWxgdff34rF1cLaSas+ySPZP/C9Zi93QDp/5iXOd54RxxakDm+3P/BFvZdGYpvZDPqmuLUSv6MYkZzNF7L2MNG8ihFPbkHFe4jr0qU4qqpDqpSizSjONLKOkP5RyQRw==</latexit> mel-spectrogram <latexit sha1_base64="D5566oBMndcdnPT9qWf93u0+azM=">AAACbHichVHLSgMxFD0dX7W+6mMhFEEsFVclo6LiSnDjslqrlVpkZho1OC9m0kIt/oBbFy7UhYKI+Blu/AEXfoIIbhTcuPDOdEBU1BuSnJzcc3OS6K4pfMnYQ0xpaW1r74h3Jrq6e3r7kv0Da75T9QxeMBzT8Yq65nNT2LwghTR50fW4ZukmX9f3FoP99Rr3fOHYq7Lu8rKl7dhiWxiaJGoj5/GKMCSvbCXTLMvCGP0J1AikEUXOSV5hExU4MFCFBQ4bkrAJDT61ElQwuMSV0SDOIyTCfY4DJEhbpSxOGRqxezTu0KoUsTatg5p+qDboFJO6R8pRZNg9u2Yv7I7dsEf2/mutRlgj8FKnWW9qubvVdzicf/tXZdEssfup+tOzxDbmQq+CvLshE9zCaOpr+8cv+fmVTGOcXbAn8n/OHtgt3cCuvRqXy3zlBAn6APX7c/8Ea5NZdSY7tTyZXpiOviKOFMYwQe89iwUsIYcCnWvhCKc4iz0rQ0pKGWmmKrFIM4gvoYx/AGXMjVw=</latexit> Predicted <latexit sha1_base64="p5PXxr+3VGJdGEsO3+KKUbsKu/s=">AAACdHichVG7SgNBFD1Z3/GRqI2ghbhEbAyTKCpWgo1lHkYFlbC7jnHJvpidBGLwB/wBCytFEfEzbPwBi3yCWEa0sfDuZkFU1LvMzpkz99w5M1f3LNOXjLViSld3T29f/0B8cGh4JJEcHdvy3ZoweMlwLVfs6JrPLdPhJWlKi+94gmu2bvFtvboe7G/XufBN19mUDY/v21rFMQ9NQ5NElZMJm1vzvscNKdyK0OxyUmVpFsb0T5CJgIoocm7yBns4gAsDNdjgcCAJW9Dg07eLDBg84vbRJE4QMsN9jhPESVujLE4ZGrFV+ldotRuxDq2Dmn6oNugUi4Yg5TRS7JHdsjZ7YHfsib3/WqsZ1gi8NGjWO1rulROnE8W3f1U2zRJHn6o/PUscYiX0apJ3L2SCWxgdff34rF1cLaSas+ySPZP/C9Zi93QDp/5iXOd54RxxakDm+3P/BFvZdGYpvZDPqmuLUSv6MYkZzNF7L2MNG8ihFPbkHFe4jr0qU4qqpDqpSizSjONLKOkP5RyQRw==</latexit> mel-spectrogram <latexit sha1_base64="D5566oBMndcdnPT9qWf93u0+azM=">AAACbHichVHLSgMxFD0dX7W+6mMhFEEsFVclo6LiSnDjslqrlVpkZho1OC9m0kIt/oBbFy7UhYKI+Blu/AEXfoIIbhTcuPDOdEBU1BuSnJzcc3OS6K4pfMnYQ0xpaW1r74h3Jrq6e3r7kv0Da75T9QxeMBzT8Yq65nNT2LwghTR50fW4ZukmX9f3FoP99Rr3fOHYq7Lu8rKl7dhiWxiaJGoj5/GKMCSvbCXTLMvCGP0J1AikEUXOSV5hExU4MFCFBQ4bkrAJDT61ElQwuMSV0SDOIyTCfY4DJEhbpSxOGRqxezTu0KoUsTatg5p+qDboFJO6R8pRZNg9u2Yv7I7dsEf2/mutRlgj8FKnWW9qubvVdzicf/tXZdEssfup+tOzxDbmQq+CvLshE9zCaOpr+8cv+fmVTGOcXbAn8n/OHtgt3cCuvRqXy3zlBAn6APX7c/8Ea5NZdSY7tTyZXpiOviKOFMYwQe89iwUsIYcCnWvhCKc4iz0rQ0pKGWmmKrFIM4gvoYx/AGXMjVw=</latexit> Predicted <latexit sha1_base64="p5PXxr+3VGJdGEsO3+KKUbsKu/s=">AAACdHichVG7SgNBFD1Z3/GRqI2ghbhEbAyTKCpWgo1lHkYFlbC7jnHJvpidBGLwB/wBCytFEfEzbPwBi3yCWEa0sfDuZkFU1LvMzpkz99w5M1f3LNOXjLViSld3T29f/0B8cGh4JJEcHdvy3ZoweMlwLVfs6JrPLdPhJWlKi+94gmu2bvFtvboe7G/XufBN19mUDY/v21rFMQ9NQ5NElZMJm1vzvscNKdyK0OxyUmVpFsb0T5CJgIoocm7yBns4gAsDNdjgcCAJW9Dg07eLDBg84vbRJE4QMsN9jhPESVujLE4ZGrFV+ldotRuxDq2Dmn6oNugUi4Yg5TRS7JHdsjZ7YHfsib3/WqsZ1gi8NGjWO1rulROnE8W3f1U2zRJHn6o/PUscYiX0apJ3L2SCWxgdff34rF1cLaSas+ySPZP/C9Zi93QDp/5iXOd54RxxakDm+3P/BFvZdGYpvZDPqmuLUSv6MYkZzNF7L2MNG8ihFPbkHFe4jr0qU4qqpDqpSizSjONLKOkP5RyQRw==</latexit> mel-spectrogram <latexit sha1_base64="ttheqiCFkr79mnAL1aAX2VjOTWY=">AAACdHichVHLSsNAFD2N7/po1Y2gi2KpuCoTFRVXghuXtrUPqEWSONbBNAnJpKDFH/AHXLhSFBE/w40/4KKfIC4V3bjwJg2IFvWGyZw5c8+dM3N1xxSeZKwdU3p6+/oHBofiwyOjY4nk+ETJs33X4EXDNm23omseN4XFi1JIk1ccl2sN3eRl/XAj2C83uesJ29qWRw6vNbS6JfaFoUmidpOJbc2tc5na892ISbMsCyPVDdQIpBHFlp28wQ72YMOAjwY4LEjCJjR49FWhgsEhroYWcS4hEe5znCBOWp+yOGVoxB7Sv06rasRatA5qeqHaoFNMGi4pU8iwR3bLXtgDu2NP7OPXWq2wRuDliGa9o+XObuJ0qvD+r6pBs8TBl+pPzxL7WA29CvLuhExwC6Ojbx6fvRTW8pnWHLtkz+T/grXZPd3Aar4a1zmeP0ecGqD+fO5uUFrIqsvZxdxCen0pasUgpjGLeXrvFaxjE1sohj05xxWuY2/KjJJWMp1UJRZpJvEtlOwnmbiQIg==</latexit> Target duration <latexit sha1_base64="p5PXxr+3VGJdGEsO3+KKUbsKu/s=">AAACdHichVG7SgNBFD1Z3/GRqI2ghbhEbAyTKCpWgo1lHkYFlbC7jnHJvpidBGLwB/wBCytFEfEzbPwBi3yCWEa0sfDuZkFU1LvMzpkz99w5M1f3LNOXjLViSld3T29f/0B8cGh4JJEcHdvy3ZoweMlwLVfs6JrPLdPhJWlKi+94gmu2bvFtvboe7G/XufBN19mUDY/v21rFMQ9NQ5NElZMJm1vzvscNKdyK0OxyUmVpFsb0T5CJgIoocm7yBns4gAsDNdjgcCAJW9Dg07eLDBg84vbRJE4QMsN9jhPESVujLE4ZGrFV+ldotRuxDq2Dmn6oNugUi4Yg5TRS7JHdsjZ7YHfsib3/WqsZ1gi8NGjWO1rulROnE8W3f1U2zRJHn6o/PUscYiX0apJ3L2SCWxgdff34rF1cLaSas+ySPZP/C9Zi93QDp/5iXOd54RxxakDm+3P/BFvZdGYpvZDPqmuLUSv6MYkZzNF7L2MNG8ihFPbkHFe4jr0qU4qqpDqpSizSjONLKOkP5RyQRw==</latexit> mel-spectrogram <latexit sha1_base64="zalZsOwrTJnssA7Or2DptbCUKH8=">AAACaXichVFNLwNBGH66vqq+ikvDpbEhTs0sgjhJXBz7TULT7K5Rw3Z3szttUo0/4OQmOJGIiJ/h4g84+AnSI4mLg7fbTQTBO5mZZ555n3eemTFcS/iSsaeI0tXd09sX7Y8NDA4Nj8RHx4q+U/NMXjAdy/E2Dd3nlrB5QQpp8U3X43rVsPiGcbDW3t+oc88Xjp2XDZeXqnrFFrvC1CVRxbzuVbgsx1WWYkEkfwItBCrCSDvxG2xjBw5M1FAFhw1J2IIOn9oWNDC4xJXQJM4jJIJ9jiPESFujLE4ZOrEHNFZotRWyNq3bNf1AbdIpFnWPlElMs0d2y17YA7tjz+z911rNoEbbS4Nmo6PlbnnkOJF7+1dVpVli71P1p2eJXSwHXgV5dwOmfQuzo68fnr7kVrLTzRl2xVrk/5I9sXu6gV1/Na8zPHuBGH2A9v25f4LiXEpbTM1n5tTVhfAropjEFGbpvZewinWkUaBz93GCM5xHWsqoklAmOqlKJNSM40so6geTAowR</latexit> Target <latexit sha1_base64="5qF69QNjEfNpNOtv0Qr/pL5UMEo=">AAACaXichVG7SgNBFD1Z3/GRqE3QRgyKVZioqFiJNpZ5mAdEkd11omP2xe4koMEfsLITtVIQET/Dxh+wyCeIZQQbC282C6JBvcPMnDlzz50zM5pjCE8y1ggpXd09vX39A+HBoeGRSHR0LO/ZVVfnOd02bLeoqR43hMVzUkiDFx2Xq6Zm8IJW2WjtF2rc9YRtbckjh++Y6r4lykJXJVH5bSlM7u1G4yzB/JjqBMkAxBFEyo7eYRt7sKGjChMcFiRhAyo8aiUkweAQt4M6cS4h4e9znCBM2iplccpQia3QuE+rUsBatG7V9Hy1TqcY1F1STmGGPbN71mRP7IG9sI9fa9X9Gi0vRzRrbS13diOnsez7vyqTZomDL9WfniXKWPG9CvLu+EzrFnpbXzs+b2ZXMzP1WXbDXsn/NWuwR7qBVXvTb9M8c4UwfUDy53N3gvx8IrmUWEgvxtfWg6/oxySmMUfvvYw1bCKFHJ17iDNc4DL0qowqMWWinaqEAs04voUS/wTGPYw4</latexit> ⇥ <latexit sha1_base64="aKvSBB8zuwxCUu3zn5mYHgE286g=">AAACZHichVHLSsNAFD2N1kettloEQRBRKoJQJgoqrgpuXPZhH1BLSeK0hqZJSNKCFrcudKu40I2CiOhfuPEHXPQHBHFZxY0Lb9OCaFHvMDNnztxz58yMbGqq7TDW8Ag9vd6+/oFB35B/eCQQHB1L20bVUnhKMTTDysqSzTVV5ylHdTSeNS0uVWSNZ+Tyems/U+OWrRr6prNr8nxFKulqUVUkh6j4QiE4yyLMjeluIHbAbLTv/E2/O/DGjOA1trANAwqqqIBDh0NYgwSbWg4iGEzi8qgTZxFS3X2OffhIW6UsThkSsWUaS7TKdVid1q2atqtW6BSNukXKaYTZI7thTfbAbtkz+/i1Vt2t0fKyS7Pc1nKzEDicSL7/q6rQ7GDnS/WnZwdFrLpeVfJuukzrFkpbX9s7bSbXEuH6HLtkL+T/gjXYPd1Ar70qV3GeOIOPPkD8+dzdIL0YEZcjS3H6iSjaMYBJzGCe3nsFUWwghhSdy3GEY5x4ngS/EBLG26mCp6MJ4VsIU5+9kI0p</latexit> + <latexit sha1_base64="Fuf+IuNYfRPhSlnGcV6/+W+MOxs=">AAACZ3ichVHLSgMxFD0d3/XRqiCCG7UqrkpGRcWV4MalrdYWVGRmjG3ovJjJFLT4Ay7cVnClICJ+hht/wEU/QVwquHHhnemAqKg3JDk5uefmJNFdU/iSsWZCaWvv6Ozq7kn29vUPpNKDQ9u+E3gGLxiO6XglXfO5KWxekEKavOR6XLN0kxf16lq4X6xxzxeOvSWPXL5naWVbHApDkyG16wfWfjrDsiyK8Z9AjUEGcWw46Rvs4gAODASwwGFDEjahwae2AxUMLnF7qBPnERLRPscJkqQNKItThkZslcYyrXZi1qZ1WNOP1AadYlL3SDmOafbIbtkLe2B37Im9/1qrHtUIvRzRrLe03N1PnY5uvv2rsmiWqHyq/vQscYjlyKsg727EhLcwWvraceNlcyU/XZ9hV+yZ/F+yJrunG9i1V+M6x/MXSNIHqN+f+yfYnsuqi9n53EJmdSr+im6MYRKz9N5LWMU6NlCgcys4QwPniSclpYwoo61UJRFrhvEllIkP1KSLOQ==</latexit> X <latexit sha1_base64="/gSmtVp4PpLyMkkTIPQRPP8rcso=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgqilBui6i4Ety47MOqYEtJ4lijaRKStFCLP+AH6MKFDxARP8ONP+DCTxBXouDGhTdpQLSod5iZM2fuuXNmRrF0zXGJHkNSW3tHZ1d3T7i3r39gMDI0vO6YVVsVedXUTXtTkR2ha4bIu5qri03LFnJF0cWGsr/i7W/UhO1oprHm1i1RrMhlQ9vRVNllqpC2zT2hejA6W4rEKEF+RFtBMgAxBJE2I9coYBsmVFRRgYABl7EOGQ63LSRBsJgrosGczUjz9wUOEWZtlbMEZ8jM7vNY5tVWwBq89mo6vlrlU3TuNiujiNMD3dAr3dMtPdHHr7Uafg3PS51npakVVmnwaCz3/q+qwrOL3S/Vn55d7GDR96qxd8tnvFuoTX3t4OQ1t5SNN6bokp7Z/wU90h3fwKi9qVcZkT1FmD8g+fO5W8F6KpGcT1AmFVueC76iG+OYxDS/9wKWsYo08nyuhWOc4Tz0Io1KE1K0mSqFAs0IvoU08wmJoY5L</latexit> Projection + <latexit sha1_base64="uw577xxHdhTBbTIN30O7lNeyTiI=">AAACZ3ichVHLSsNAFD2Nr1ofrQpScKMWxVW5qaLiquDGZatWBRVJ4miHpklI0kIt/oALtxVcKYiIn+HGH3DhJ4hLBTcuvEkDoqLeYWbOnLnnzpkZ3TGl5xM9xpSOzq7unnhvoq9/YDCZGhre8Oyaa4iSYZu2u6VrnjClJUq+9E2x5bhCq+qm2NQry8H+Zl24nrStdb/hiN2qdmjJA2lofkDpUvP2UhnKUhjjP4EagQyiKNipa+xgHzYM1FCFgAWfsQkNHrdtqCA4zO2iyZzLSIb7AsdIsLbGWYIzNGYrPB7yajtiLV4HNb1QbfApJneXleOYoge6oRe6p1t6ovdfazXDGoGXBs96WyucveRJeu3tX1WVZx/lT9Wfnn0cYDH0Ktm7EzLBLYy2vn7UellbWp1qTtMlPbP/C3qkO76BVX81ropi9RwJ/gD1+3P/BBu5rDqfnS3mMvm56CviGMMkZvi9F5DHCgoo8bllnKKFs9iTklRGlXQ7VYlFmhF8CWXiA7S+izU=</latexit> bias <latexit sha1_base64="JfxVmiGF3789HWPdjBiBXDUu5L4=">AAACeXichVG9ThtBEP584ceYAM5PgZTmgmWEUlhzBmGTComGEgwGJMey9i6LWXF/ujtbwlZeIC9AQZMgIQQ8Bk1egIJHQJQgUYSCubMjlMIwq92d/Wa+mW93Td9WYUR0ndLeDA2PjKbHMuNvJyansu/eb4VeK7Bk1fJsL9gxRSht5cpqpCJb7viBFI5py21zfyWOb7dlECrP3YwOfFl3RNNVu8oSEUON7MfNQChXcLpe9UPhcE+32cjmqEBEhmHosWOUFomdpaVy0SjrRhxiy6Fva172FN/wHR4stOBAwkXEvg2BkEcNBgg+Y3V0GQvYU0lc4gcyzG1xluQMweg+r00+1fqoy+e4ZpiwLe5i8wyYqSNPV3RGd/SHLuiGHgfW6iY1Yi0HvJs9rvQbUz+nNx5eZTm8R9h7Zr2oOcIuyolWxdr9BIlvYfX47c7h3cbXSr47S8d0y/p/0zVd8g3c9r11si4rR8jwB/x7ZX2ws1UsGIuF+fVibnmh/xVpfMIM5vi9S1jGKtZQ5b4d/MIZzlN/tc/anPall6ql+pwP+M+0+SeoBpJv</latexit> Trainable Upsampling <latexit sha1_base64="m7j1D77R7TRXEO23B2rvubHtTRo=">AAACZnichVHLSsNAFD2Nr1ofrYoouCmWiqtyU5+4Krhx2YfVQpWSxLEG0yQkaUGLPyC4tQtXCiLiZ7jxB1z4B4pLBTcuvE0DoqLeYWbOnLnnzpkZ1TZ01yN6CEld3T29feH+yMDg0HA0NjK64Vp1RxNFzTIsp6QqrjB0UxQ93TNEyXaEUlMNsanur7b3NxvCcXXLXPcObLFdU6qmvqtrisdUYUFOV2IJSpEf8Z9ADkACQWSt2BW2sAMLGuqoQcCEx9iAApdbGTIINnPbaDLnMNL9fYEjRFhb5yzBGQqz+zxWeVUOWJPX7Zqur9b4FIO7w8o4knRP1/RCd3RDT/T+a62mX6Pt5YBntaMVdiV6PFl4+1dV49nD3qfqT88edrHse9XZu+0z7VtoHX3jsPVSWMknmzN0Qc/s/5we6JZvYDZetcucyJ8hwh8gf3/un2AjnZIXU3O5dCIzH3xFGFOYxiy/9xIyWEMWRT63ihOcohV6lIalcWmikyqFAs0YvoQU/wB/fook</latexit> 512 <latexit sha1_base64="nuIIHvAEtsm36hSk7+uj7UEU/qI=">AAACb3ichVHNLixBFP6mcTHca7AgkUjHhLDpnJ7BGCuJSCz9DRJEuntq6Ojp7nTXTDDxAh6AhYWfREQ8ho0XsPAIYiUkNhbO9IyIBfdUqs6pr853zldVpu/YoSR6iCkNjU1/mlta423tf/91JDq7lkOvFFgiZ3mOF6yaRigc2xU5aUtHrPqBMIqmI1bMnenq+UpZBKHtuUtyzxcbRWPLtQu2ZUiG1pfErlRn3LyXF8FmIkmanspkxnSVtGw2mxlL1wJKT6i6RpElUbc5L3GFdeThwUIJRQi4kBw7MBDyWIMOgs/YBiqMBRzZ0bnAAeLMLXGW4AyD0R1et3i3Vkdd3ldrhhHb4i4Oz4CZKgbpnq7phe7ohh7p/cdalahGVcsee7PGFf5mx2Hv4tt/WUX2EttfrF81SxQwEWm1WbsfIdVbWDV+ef/4ZXFyYbAyRBf0xPrP6YFu+QZu+dW6nBcLJ4jzB3y+svpzsJzS9HEtPZ9KTo3Wv6IFfRjAML93BlOYxRxy3NfHEU5xFntWepR+Ra2lKrE6pxvfTBn5AIrpjtM=</latexit> Text Endoder <latexit sha1_base64="0Okg3WoAinu7tCTlfINB1cxNk1U=">AAACanichVHLSsNAFD2N7/qqdaN0U6yKq3LrG1cFXbjsw1pBS0niVINpEpK0oMUfcOdKsCsFEfEz3PgDLvoJorsKblx4k0bEhXqHmXvnzD13ztxRLF1zXKJWSOrq7unt6x8IDw4Nj4xGxqLbjlmzVVFQTd20dxTZEbpmiIKrubrYsWwhVxVdFJWjde+8WBe2o5nGlntsiVJVPjC0iqbKLkPFDaGa+8IuRxKUXCLP4pSkryBAUgGSQGAZM3KLPezDhIoaqhAw4HKsQ4bDYxcpECzGSmgwZnOk+ecCpwgzt8ZZgjNkRo94PeDdboAavPdqOj5b5Vt0njYz45ihJ7qjNj3SPT3Tx6+1Gn4NT8sxe6XDFVZ59Gwi//4vq8rexeE360/NLipY9bVqrN3yEe8VaodfP7lo59dyM41ZuqYX1n9FLXrgFxj1N/UmK3JNhPkDvroc/z3Ynk+mlpML2flEejH4in7EMIU57vcK0thEBgVf3Tku0Qy9SlFpUop1UqVQwBnHD5OmPwFry4x0</latexit> Decoder <latexit sha1_base64="m7j1D77R7TRXEO23B2rvubHtTRo=">AAACZnichVHLSsNAFD2Nr1ofrYoouCmWiqtyU5+4Krhx2YfVQpWSxLEG0yQkaUGLPyC4tQtXCiLiZ7jxB1z4B4pLBTcuvE0DoqLeYWbOnLnnzpkZ1TZ01yN6CEld3T29feH+yMDg0HA0NjK64Vp1RxNFzTIsp6QqrjB0UxQ93TNEyXaEUlMNsanur7b3NxvCcXXLXPcObLFdU6qmvqtrisdUYUFOV2IJSpEf8Z9ADkACQWSt2BW2sAMLGuqoQcCEx9iAApdbGTIINnPbaDLnMNL9fYEjRFhb5yzBGQqz+zxWeVUOWJPX7Zqur9b4FIO7w8o4knRP1/RCd3RDT/T+a62mX6Pt5YBntaMVdiV6PFl4+1dV49nD3qfqT88edrHse9XZu+0z7VtoHX3jsPVSWMknmzN0Qc/s/5we6JZvYDZetcucyJ8hwh8gf3/un2AjnZIXU3O5dCIzH3xFGFOYxiy/9xIyWEMWRT63ihOcohV6lIalcWmikyqFAs0YvoQU/wB/fook</latexit> 512 <latexit sha1_base64="mRSSCUnJwB9iH3oIP+Dqhhsi7KI=">AAACZ3ichVHLSsNAFD2N7/poVZCCm2pRXJWbKiquBDcu66NVUClJHG0wTUIyLWjxB1y4VXClICJ+hht/wIWfUFxWcOPCmzQgWtQ7zMyZM/fcOTOju5bpS6KXmNLR2dXd09sX7x8YHEokh0eKvlP1DFEwHMvxtnXNF5Zpi4I0pSW2XU9oFd0SW/rRSrC/VROebzr2pjx2xV5FO7TNA9PQZECplJsrJTOUpTDS7UCNQAZR5J3kHXaxDwcGqqhAwIZkbEGDz20HKgguc3uoM+cxMsN9gVPEWVvlLMEZGrNHPB7yaidibV4HNf1QbfApFnePlWlM0TPdU5Oe6IEa9PFrrXpYI/ByzLPe0gq3lDhLbbz/q6rwLFH+Uv3pWeIAi6FXk727IRPcwmjpaycXzY2l9an6NN3QK/u/phd65BvYtTfjdk2sXyHOH6D+fO52UMxl1fns7FouszwXfUUvxjGJGX7vBSxjFXkU+NwyznGBy1hDSShjSqqVqsQizSi+hTLxCQN7il0=</latexit> 1024 <latexit sha1_base64="z6OA2MZLu1/50o8pAAlnFE5dymk=">AAACZXichVHLSsNAFD2Nr1pf9YEILhSL4qrcVtHiquDGZR+2ClokiVMNTZOQpIVa/AFxqy5cKYiIn+HGH3DRLxBxWcGNC2/TgGhR7zAzZ87cc+fMjGLpmuMSNQJSV3dPb1+wPzQwODQ8Eh4dyztmxVZFTjV1095WZEfomiFyrubqYtuyhVxWdLGllNZb+1tVYTuaaWy6NUsUyvKBoRU1VXaZyiRoLxyhKHkx2wliPojAj5QZvsUu9mFCRQVlCBhwGeuQ4XDbQQwEi7kC6szZjDRvX+AYIdZWOEtwhsxsiccDXu34rMHrVk3HU6t8is7dZuUs5umJ7qhJj3RPL/Txa626V6Plpcaz0tYKa2/kZCr7/q+qzLOLwy/Vn55dFJHwvGrs3fKY1i3Utr56dNHMrmXm6wt0Ta/s/4oa9MA3MKpv6k1aZC4R4g+I/XzuTpCPR2Mr0aV0PJJc9r8iiGnMYZHfexVJbCCFHJ9bxCnOcB54loakCWmynSoFfM04voU08wn5qonq</latexit> 80 <latexit sha1_base64="BQSk9DXG3FQsfEuMzxOTolVVn78=">AAACdHichVHLTsJAFD3UF+ID1I2JLogE44pM0ahhRcLGJQ95JEhIWwdsKG3TFhIk/oA/4IKVRmKMn+HGH3DBJxiXGN248FKaGDXqbdo598w9t2fmyqam2g5jA58wMTk1PeOfDczNLywGQ0vLBdtoWQrPK4ZmWCVZsrmm6jzvqI7GS6bFpaas8aLcSI32i21u2aqhHzodk1eaUl1Xa6oiOURVQ8FEOGXolHHdYyIsxtwI/wSiByLwIm2EbnCEYxhQ0EITHDocwhok2PSUIYLBJK6CLnEWIdXd5zhDgLQtquJUIRHboG+dsrLH6pSPetquWqG/aPRapAwjyh7ZLRuyB3bHntj7r726bo+Rlw6t8ljLzWrwfDX39q+qSauDk0/Vn54d1LDvelXJu+kyo1MoY3379GKYS2Sj3U12xZ7J/yUbsHs6gd5+UfoZnu0hQAMQv1/3T1CIx8Td2HYmHknueKPwYw0b2KL73kMSB0gj786kh2v0fa/CuhARouNSwedpVvAlhNgH+tmP1Q==</latexit> : Concatenation <latexit sha1_base64="TOgylvCdcInHihfIUFcKkQDk9IA=">AAACbnichVHLSsNAFD2Nr1pfVUEEEYtFcVWmVVS6KrhxWa3VQi2SxLEdTJOQTCu1+APuxYWgKIiIn+HGH3DRTxA3QgU3LrxNA6Ki3jCZM2fuuXPmjmYbwpWMNQJKR2dXd0+wN9TXPzA4FB4e2XStiqPzrG4ZlpPTVJcbwuRZKaTBc7bD1bJm8C1tf6W1v1Xljissc0PWbF4oq0VT7AldlUTlk5HMgZB6SZjFnXCUxZgXkZ8g7oMo/Ehb4RtsYxcWdFRQBocJSdiACpe+POJgsIkroE6cQ0h4+xxHCJG2QlmcMlRi9+lfpFXeZ01at2q6nlqnUwwaDikjmGGP7JY12QO7Y0/s/ddada9Gy0uNZq2t5fbO0PF45u1fVZlmidKn6k/PEntY9rwK8m57TOsWeltfPTxtZpLrM/VZdsWeyf8la7B7uoFZfdWv1/j6GUL0APHv7f4JNhOx+GJsfi0RTS34TxHEBKYxR/1eQgqrSCPrdewE57gIvChjyqQy1U5VAr5mFF9CmfsAoK6N5g==</latexit> : Switching <latexit sha1_base64="9K7p9AkiNfAJyMKmuFPett/1dwc=">AAACdHichVHLSsNAFD2N7/po1Y2gi2KpuCrTKiquCm5c9qmFKiWJYx2aTkKSFmrxB/wBF10pFhE/w40/4KKfIC4runHhbRoQFfWGyZw5c8+dM3M1yxCOy1g3oAwNj4yOjU8EJ6emZ0Lh2bk9x6zbOi/opmHaRU11uCEkL7jCNXjRsrla0wy+r1V3+vv7DW47wpR5t2nxw5pakeJY6KpLVDkc2o7kbVVIISsRUxrNcjjK4syLyE+Q8EEUfqTN8A0OcAQTOuqogUPCJWxAhUNfCQkwWMQdokWcTUh4+xxnCJK2TlmcMlRiq/Sv0Krks5LW/ZqOp9bpFIOGTcoIYuyR3bIee2B37Im9/1qr5dXoe2nSrA203CqHzhdyb/+qajS7OPlU/enZxTG2PK+CvFse07+FPtA3Ti96ue1srLXCrtgz+b9kXXZPN5CNF72T4dk2gtSAxPfn/gn2kvHERnwtk4ym1v1WjGMRy1il995ECrtIo+D1pI1rdAKvypISVWKDVCXga+bxJZT4B6qcj60=</latexit> : Training only <latexit sha1_base64="KzOOvpZ1uWFyH6ibpqIoNC5130I=">AAACdXichVHLSsNAFD2Nr1pfUTeCCMVqcVWnVVS6KrjRXR9WBZWSxGkNppOQpIVa/AF/wIVuFKqIn+HGH3DRTxCXFbpx4W0aEC3qHWbmzJl77pyZUS1Dd1zGmgGpr39gcCg4HBoZHRufkCendh2zYms8r5mGae+risMNXfC8q7sG37dsrpRVg++pp5ud/b0qtx3dFDtuzeJHZaUk9KKuKS5RBVlOhrdFkdtcaDxsCqNWkCMsxrwI94K4DyLwI23K9zjEMUxoqKAMDgGXsAEFDrUDxMFgEXeEOnE2Id3b5zhHiLQVyuKUoRB7SmOJVgc+K2jdqel4ao1OMajbpAxjkb2wB9Ziz+yRvbKPX2vVvRodLzWa1a6WW4WJi5lc+19VmWYXJ1+qPz27KGLD86qTd8tjOrfQuvrq2WUrl8wu1qPslr2R/xvWZE90A1F91xoZnr1CiD4g/vO5e8FuIhZfi61kEpHUqv8VQcxiHkv03utIYQtp5OncKq7RwF2gLc1JC1K0myoFfM00voW0/Al7EZAK</latexit> : Inference only <latexit sha1_base64="STbwX0JctNkJ6BbUl3deVU11gUQ=">AAACbHichVG7SgNBFD1Z3/GR+CgEERaDYhVmo6hYCTYWFokaE4kiu+uoQ/bF7iYQgz9ga2GhFgoi4mfY+AMWfoIINgo2Ft7dLIgG9Q4zc+bMPXfOzGiOITyfsceY1NLa1t7R2RXv7untSyT7B9Y9u+LqPK/bhu0WNdXjhrB43he+wYuOy1VTM3hBKy8G+4Uqdz1hW2t+zeFbprpniV2hqz5RG/PysiIv2563nUyxNAtDbgZKBFKIImsnr7GJHdjQUYEJDgs+YQMqPGolKGBwiNtCnTiXkAj3OQ4RJ22FsjhlqMSWadyjVSliLVoHNb1QrdMpBnWXlDLG2QO7Ya/snt2yJ/bxa616WCPwUqNZa2i5s504Gl59/1dl0uxj/0v1p2cfu5gLvQry7oRMcAu9oa8enLyuzq+M1yfYJXsm/xfskd3RDazqm36V4yuniNMHKD+fuxmsZ9LKTHoql0ktTEdf0YkRjGGS3nsWC1hCFnk618QxznAee5GGpBFptJEqxSLNIL6FNPEJZ8aMYA==</latexit> : L1 Loss <latexit sha1_base64="GAL0zIVs3w38p7EuO2l3o1i17LE=">AAACdnichVFNLwNBGH66vuuruEgk0miKU/MWQZyaOHBwoBQJ0uyuwcR2d7M7rdD4A/6AgziQ0Iif4eIPOPQniCMJBwdvt5sIgncyM8888z7vPDNjuJb0FVE1ojU0NjW3tLZF2zs6u7pjPb2rvlP0TJEzHcvx1g3dF5a0RU5JZYl11xN6wbDEmrE/W9tfKwnPl469og5dsVXQd225I01dMZWP9czpSmzHF1iue/GcLVU+lqAUBRH/CdIhSCCMRSdWwSa24cBEEQUI2FCMLejwuW0gDYLL3BbKzHmMZLAvcIwoa4ucJThDZ3afx11ebYSszetaTT9Qm3yKxd1jZRxJeqAbeqZ7uqVHev+1VjmoUfNyyLNR1wo3333Sv/z6r6rAs8Lep+pPzwo7mA68SvbuBkztFmZdXzo6fV6eySbLw3RJT+z/gqp0xzewSy/m1ZLIniHKH5D+/tw/wepYKj2ZGl8aS2Qmwq9oxQCGMMrvPYUM5rGIHJ97gHNcoxJ50wa1pDZST9UioaYPX0KjD1KikGk=</latexit> Gated Linear Unit <latexit sha1_base64="mcqL04UghKCQy2S5zwMFI1tyWHM=">AAACaHichVHLSsNAFD2N7/qKulBxIy2KqzJRUXFV6MaFiz5MW6giSRx1ME1Ckga0+ANuXKq4UhARP8ONP+Cin6AuFdy48DYNiIp6h5k5c+aeO2dmdMcUns9YIya1tXd0dnX3xHv7+gcG5aHhomfXXIOrhm3ablnXPG4Ki6u+8E1edlyuVXWTl/S9THO/FHDXE7a15u87fKOq7VhiWxiaT5S6mrGtYFNOshQLY/InUCKQRBRZW77GOrZgw0ANVXBY8Amb0OBRq0ABg0PcBurEuYREuM9xiDhpa5TFKUMjdo/GHVpVItaidbOmF6oNOsWk7pJyElPsgd2wF3bPbtkje/+1Vj2s0fSyT7Pe0nJnc/BorPD2r6pKs4/dT9Wfnn1sYyn0Ksi7EzLNWxgtfXBw8lJYzk/Vp9kleyb/F6zB7ugGVvBqXOV4/hxx+gDl+3P/BMXZlLKQmsvNJtPz0Vd0YwIJzNB7LyKNFWSh0rkCxzjFWexJkqVRabyVKsUizQi+hJT4AGEfi4I=</latexit> LConv <latexit sha1_base64="aKvSBB8zuwxCUu3zn5mYHgE286g=">AAACZHichVHLSsNAFD2N1kettloEQRBRKoJQJgoqrgpuXPZhH1BLSeK0hqZJSNKCFrcudKu40I2CiOhfuPEHXPQHBHFZxY0Lb9OCaFHvMDNnztxz58yMbGqq7TDW8Ag9vd6+/oFB35B/eCQQHB1L20bVUnhKMTTDysqSzTVV5ylHdTSeNS0uVWSNZ+Tyems/U+OWrRr6prNr8nxFKulqUVUkh6j4QiE4yyLMjeluIHbAbLTv/E2/O/DGjOA1trANAwqqqIBDh0NYgwSbWg4iGEzi8qgTZxFS3X2OffhIW6UsThkSsWUaS7TKdVid1q2atqtW6BSNukXKaYTZI7thTfbAbtkz+/i1Vt2t0fKyS7Pc1nKzEDicSL7/q6rQ7GDnS/WnZwdFrLpeVfJuukzrFkpbX9s7bSbXEuH6HLtkL+T/gjXYPd1Ar70qV3GeOIOPPkD8+dzdIL0YEZcjS3H6iSjaMYBJzGCe3nsFUWwghhSdy3GEY5x4ngS/EBLG26mCp6MJ4VsIU5+9kI0p</latexit> + <latexit sha1_base64="/gSmtVp4PpLyMkkTIPQRPP8rcso=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgqilBui6i4Ety47MOqYEtJ4lijaRKStFCLP+AH6MKFDxARP8ONP+DCTxBXouDGhTdpQLSod5iZM2fuuXNmRrF0zXGJHkNSW3tHZ1d3T7i3r39gMDI0vO6YVVsVedXUTXtTkR2ha4bIu5qri03LFnJF0cWGsr/i7W/UhO1oprHm1i1RrMhlQ9vRVNllqpC2zT2hejA6W4rEKEF+RFtBMgAxBJE2I9coYBsmVFRRgYABl7EOGQ63LSRBsJgrosGczUjz9wUOEWZtlbMEZ8jM7vNY5tVWwBq89mo6vlrlU3TuNiujiNMD3dAr3dMtPdHHr7Uafg3PS51npakVVmnwaCz3/q+qwrOL3S/Vn55d7GDR96qxd8tnvFuoTX3t4OQ1t5SNN6bokp7Z/wU90h3fwKi9qVcZkT1FmD8g+fO5W8F6KpGcT1AmFVueC76iG+OYxDS/9wKWsYo08nyuhWOc4Tz0Io1KE1K0mSqFAs0IvoU08wmJoY5L</latexit> Projection + <latexit sha1_base64="uw577xxHdhTBbTIN30O7lNeyTiI=">AAACZ3ichVHLSsNAFD2Nr1ofrQpScKMWxVW5qaLiquDGZatWBRVJ4miHpklI0kIt/oALtxVcKYiIn+HGH3DhJ4hLBTcuvEkDoqLeYWbOnLnnzpkZ3TGl5xM9xpSOzq7unnhvoq9/YDCZGhre8Oyaa4iSYZu2u6VrnjClJUq+9E2x5bhCq+qm2NQry8H+Zl24nrStdb/hiN2qdmjJA2lofkDpUvP2UhnKUhjjP4EagQyiKNipa+xgHzYM1FCFgAWfsQkNHrdtqCA4zO2iyZzLSIb7AsdIsLbGWYIzNGYrPB7yajtiLV4HNb1QbfApJneXleOYoge6oRe6p1t6ovdfazXDGoGXBs96WyucveRJeu3tX1WVZx/lT9Wfnn0cYDH0Ktm7EzLBLYy2vn7UellbWp1qTtMlPbP/C3qkO76BVX81ropi9RwJ/gD1+3P/BBu5rDqfnS3mMvm56CviGMMkZvi9F5DHCgoo8bllnKKFs9iTklRGlXQ7VYlFmhF8CWXiA7S+izU=</latexit> bias <latexit sha1_base64="qfXNZiLecH30BxAQeNzJnYoR33k=">AAACbnichVHLSsNAFD2Nr1ofrQoiiCgWxVWZVlFxVRDEZR9WhSqSpNM6NE3CJK3U4g+4FxeCoiAifoYbf8CFnyBuBAU3LrxNA6Ki3jCZM2fuuXPmjmYbwnEZewgobe0dnV3B7lBPb19/ODIwuO5YVanznG4ZltzUVIcbwuQ5V7gG37QlVyuawTe08nJzf6PGpSMsc82t23y7opZMURS66hKVX+G8ULTknioLO5EoizEvJn6CuA+i8CNlRa6whQIs6KiiAg4TLmEDKhz68oiDwSZuGw3iJCHh7XMcIETaKmVxylCJLdO/RKu8z5q0btZ0PLVOpxg0JCknMMXu2TV7YXfshj2y919rNbwaTS91mrWWlts74cOR7Nu/qgrNLnY/VX96dlHEoudVkHfbY5q30Fv62v7xS3YpM9WYZhfsifyfswd2Szcwa6/6ZZpnThCiB4h/b/dPsJ6Ixedjs+lENDnnP0UQo5jEDPV7AUmsIoWc17EjnOIs8KwMK2PKeCtVCfiaIXwJZeYDYd+ORQ==</latexit> Feedforward <latexit sha1_base64="aKvSBB8zuwxCUu3zn5mYHgE286g=">AAACZHichVHLSsNAFD2N1kettloEQRBRKoJQJgoqrgpuXPZhH1BLSeK0hqZJSNKCFrcudKu40I2CiOhfuPEHXPQHBHFZxY0Lb9OCaFHvMDNnztxz58yMbGqq7TDW8Ag9vd6+/oFB35B/eCQQHB1L20bVUnhKMTTDysqSzTVV5ylHdTSeNS0uVWSNZ+Tyems/U+OWrRr6prNr8nxFKulqUVUkh6j4QiE4yyLMjeluIHbAbLTv/E2/O/DGjOA1trANAwqqqIBDh0NYgwSbWg4iGEzi8qgTZxFS3X2OffhIW6UsThkSsWUaS7TKdVid1q2atqtW6BSNukXKaYTZI7thTfbAbtkz+/i1Vt2t0fKyS7Pc1nKzEDicSL7/q6rQ7GDnS/WnZwdFrLpeVfJuukzrFkpbX9s7bSbXEuH6HLtkL+T/gjXYPd1Ar70qV3GeOIOPPkD8+dzdIL0YEZcjS3H6iSjaMYBJzGCe3nsFUWwghhSdy3GEY5x4ngS/EBLG26mCp6MJ4VsIU5+9kI0p</latexit> + <latexit sha1_base64="mcqL04UghKCQy2S5zwMFI1tyWHM=">AAACaHichVHLSsNAFD2N7/qKulBxIy2KqzJRUXFV6MaFiz5MW6giSRx1ME1Ckga0+ANuXKq4UhARP8ONP+Cin6AuFdy48DYNiIp6h5k5c+aeO2dmdMcUns9YIya1tXd0dnX3xHv7+gcG5aHhomfXXIOrhm3ablnXPG4Ki6u+8E1edlyuVXWTl/S9THO/FHDXE7a15u87fKOq7VhiWxiaT5S6mrGtYFNOshQLY/InUCKQRBRZW77GOrZgw0ANVXBY8Amb0OBRq0ABg0PcBurEuYREuM9xiDhpa5TFKUMjdo/GHVpVItaidbOmF6oNOsWk7pJyElPsgd2wF3bPbtkje/+1Vj2s0fSyT7Pe0nJnc/BorPD2r6pKs4/dT9Wfnn1sYyn0Ksi7EzLNWxgtfXBw8lJYzk/Vp9kleyb/F6zB7ugGVvBqXOV4/hxx+gDl+3P/BMXZlLKQmsvNJtPz0Vd0YwIJzNB7LyKNFWSh0rkCxzjFWexJkqVRabyVKsUizQi+hJT4AGEfi4I=</latexit> LConv <latexit sha1_base64="Jgmd9Gi+6KimxD9gH/0r6WQoavc=">AAACaHichVFNLwNBGH66vqq+igPiIm2IUzNFECfh4qitRYLI7pjWpPuV3W2TavwBF0fEiURE/AwXf8ChPwHHSlwcvN1uIjR4JzPzzDPv884zM7pjSM9nrBZR2to7Orui3bGe3r7+gfjg0KZnl1wuVG4btruta54wpCVUX/qG2HZcoZm6Ibb04mpjf6ssXE/a1oZfccSeqRUsmZdc84lSVwybF/fjSZZiQUy0gnQIkghj3Y7fYhcHsMFRggkBCz5hAxo8ajtIg8Ehbg9V4lxCMtgXOEaMtCXKEpShEVuksUCrnZC1aN2o6QVqTqcY1F1STmCSPbE7VmeP7J49s49fa1WDGg0vFZr1plY4+wMno7n3f1UmzT4Ov1R/evaRx2LgVZJ3J2Aat+BNffnorJ5byk5Wp9g1eyX/V6zGHugGVvmN32RE9hIx+oD0z+duBZszqfR8ajYzk1yeC78iinEkME3vvYBlrGEdKp0rcYpzXERelLgyoow1U5VIqBnGt1ASn3Nni4s=</latexit> Block <latexit sha1_base64="pBbdgz3Pqutv81qiXOoX+nf0PkM=">AAACbnichVHLSsNAFD2Nr1ofrQoiiFgsiqsy1aLiquDGlfRhVahFkjja0DQJybRYS3/AvbgQFAUR8TPc+AMu+gniRqjgxoW3aUC0qDdM5syZe+6cuaNYuuYIxho+qau7p7fP3x8YGBwaDoZGRrccs2yrPKuaumnvKLLDdc3gWaEJne9YNpdLis63leJaa3+7wm1HM41NUbV4viQfGtqBpsqCqNzGruBHohZWC/W9UIRFmRvhThDzQAReJM3QLXaxDxMqyiiBw4AgrEOGQ18OMTBYxOVRI84mpLn7HHUESFumLE4ZMrFF+h/SKuexBq1bNR1XrdIpOg2blGHMsid2x5rskd2zZ/bxa62aW6PlpUqz0tZyay94MpF5/1dVolmg8KX607PAAVZcrxp5t1ymdQu1ra8cnzUzq+nZ2hy7Zi/k/4o12APdwKi8qTcpnj5HgB4g9rPdnWBrIRpbii6m4pFE3HsKPyYxg3nq9zISWEcSWbdjp7jApe9VGpempOl2quTzNGP4FtL8JzSbjjA=</latexit> N ch <latexit sha1_base64="Xsk+ci3xhD3bEtF9UEE2fqi3VjM=">AAACb3ichVHLSgMxFD0d3/XRqgsFQYqlopuSqqi4KrhxJW21D2iLzIzRDk5nhpm0WEt/wA/QhQsfICJ+hht/wIWfIK6kghsX3k4HRIt6Q5KTk3tuThLF0jVHMPbkk7q6e3r7+gf8g0PDI4Hg6FjGMSu2ytOqqZt2TpEdrmsGTwtN6Dxn2VwuKzrPKgfrrf1slduOZhrbombxYlneN7Q9TZUFUYWFzYLgh6IeUkuNnWCYRZkboU4Q80AYXiTM4A0K2IUJFRWUwWFAENYhw6GWRwwMFnFF1ImzCWnuPkcDftJWKItThkzsAY37tMp7rEHrVk3HVat0ik7dJmUIEfbIblmTPbA79sw+fq1Vd2u0vNRoVtpabu0Ejie33v9VlWkWKH2p/vQssIdV16tG3i2Xad1CbeurR6fNrbVUpD7LrtgL+b9kT+yebmBU39TrJE+dwU8fEPv53J0gsxCNLUcXk0vh+JL3Ff2Ywgzm6L1XEMcGEkjTuRZOcI4L36s0IU1LoXaq5PM04/gW0vwnwDWObA==</latexit> 2N ch <latexit sha1_base64="pBbdgz3Pqutv81qiXOoX+nf0PkM=">AAACbnichVHLSsNAFD2Nr1ofrQoiiFgsiqsy1aLiquDGlfRhVahFkjja0DQJybRYS3/AvbgQFAUR8TPc+AMu+gniRqjgxoW3aUC0qDdM5syZe+6cuaNYuuYIxho+qau7p7fP3x8YGBwaDoZGRrccs2yrPKuaumnvKLLDdc3gWaEJne9YNpdLis63leJaa3+7wm1HM41NUbV4viQfGtqBpsqCqNzGruBHohZWC/W9UIRFmRvhThDzQAReJM3QLXaxDxMqyiiBw4AgrEOGQ18OMTBYxOVRI84mpLn7HHUESFumLE4ZMrFF+h/SKuexBq1bNR1XrdIpOg2blGHMsid2x5rskd2zZ/bxa62aW6PlpUqz0tZyay94MpF5/1dVolmg8KX607PAAVZcrxp5t1ymdQu1ra8cnzUzq+nZ2hy7Zi/k/4o12APdwKi8qTcpnj5HgB4g9rPdnWBrIRpbii6m4pFE3HsKPyYxg3nq9zISWEcSWbdjp7jApe9VGpempOl2quTzNGP4FtL8JzSbjjA=</latexit> N ch <latexit sha1_base64="9K7p9AkiNfAJyMKmuFPett/1dwc=">AAACdHichVHLSsNAFD2N7/po1Y2gi2KpuCrTKiquCm5c9qmFKiWJYx2aTkKSFmrxB/wBF10pFhE/w40/4KKfIC4runHhbRoQFfWGyZw5c8+dM3M1yxCOy1g3oAwNj4yOjU8EJ6emZ0Lh2bk9x6zbOi/opmHaRU11uCEkL7jCNXjRsrla0wy+r1V3+vv7DW47wpR5t2nxw5pakeJY6KpLVDkc2o7kbVVIISsRUxrNcjjK4syLyE+Q8EEUfqTN8A0OcAQTOuqogUPCJWxAhUNfCQkwWMQdokWcTUh4+xxnCJK2TlmcMlRiq/Sv0Krks5LW/ZqOp9bpFIOGTcoIYuyR3bIee2B37Im9/1qr5dXoe2nSrA203CqHzhdyb/+qajS7OPlU/enZxTG2PK+CvFse07+FPtA3Ti96ue1srLXCrtgz+b9kXXZPN5CNF72T4dk2gtSAxPfn/gn2kvHERnwtk4ym1v1WjGMRy1il995ECrtIo+D1pI1rdAKvypISVWKDVCXga+bxJZT4B6qcj60=</latexit> : Training only <latexit sha1_base64="KzOOvpZ1uWFyH6ibpqIoNC5130I=">AAACdXichVHLSsNAFD2Nr1pfUTeCCMVqcVWnVVS6KrjRXR9WBZWSxGkNppOQpIVa/AF/wIVuFKqIn+HGH3DRTxCXFbpx4W0aEC3qHWbmzJl77pyZUS1Dd1zGmgGpr39gcCg4HBoZHRufkCendh2zYms8r5mGae+risMNXfC8q7sG37dsrpRVg++pp5ud/b0qtx3dFDtuzeJHZaUk9KKuKS5RBVlOhrdFkdtcaDxsCqNWkCMsxrwI94K4DyLwI23K9zjEMUxoqKAMDgGXsAEFDrUDxMFgEXeEOnE2Id3b5zhHiLQVyuKUoRB7SmOJVgc+K2jdqel4ao1OMajbpAxjkb2wB9Ziz+yRvbKPX2vVvRodLzWa1a6WW4WJi5lc+19VmWYXJ1+qPz27KGLD86qTd8tjOrfQuvrq2WUrl8wu1qPslr2R/xvWZE90A1F91xoZnr1CiD4g/vO5e8FuIhZfi61kEpHUqv8VQcxiHkv03utIYQtp5OncKq7RwF2gLc1JC1K0myoFfM00voW0/Al7EZAK</latexit> : Inference only <latexit sha1_base64="BQSk9DXG3FQsfEuMzxOTolVVn78=">AAACdHichVHLTsJAFD3UF+ID1I2JLogE44pM0ahhRcLGJQ95JEhIWwdsKG3TFhIk/oA/4IKVRmKMn+HGH3DBJxiXGN248FKaGDXqbdo598w9t2fmyqam2g5jA58wMTk1PeOfDczNLywGQ0vLBdtoWQrPK4ZmWCVZsrmm6jzvqI7GS6bFpaas8aLcSI32i21u2aqhHzodk1eaUl1Xa6oiOURVQ8FEOGXolHHdYyIsxtwI/wSiByLwIm2EbnCEYxhQ0EITHDocwhok2PSUIYLBJK6CLnEWIdXd5zhDgLQtquJUIRHboG+dsrLH6pSPetquWqG/aPRapAwjyh7ZLRuyB3bHntj7r726bo+Rlw6t8ljLzWrwfDX39q+qSauDk0/Vn54d1LDvelXJu+kyo1MoY3379GKYS2Sj3U12xZ7J/yUbsHs6gd5+UfoZnu0hQAMQv1/3T1CIx8Td2HYmHknueKPwYw0b2KL73kMSB0gj786kh2v0fa/CuhARouNSwedpVvAlhNgH+tmP1Q==</latexit> : Concatenation <latexit sha1_base64="TOgylvCdcInHihfIUFcKkQDk9IA=">AAACbnichVHLSsNAFD2Nr1pfVUEEEYtFcVWmVVS6KrhxWa3VQi2SxLEdTJOQTCu1+APuxYWgKIiIn+HGH3DRTxA3QgU3LrxNA6Ki3jCZM2fuuXPmjmYbwpWMNQJKR2dXd0+wN9TXPzA4FB4e2XStiqPzrG4ZlpPTVJcbwuRZKaTBc7bD1bJm8C1tf6W1v1Xljissc0PWbF4oq0VT7AldlUTlk5HMgZB6SZjFnXCUxZgXkZ8g7oMo/Ehb4RtsYxcWdFRQBocJSdiACpe+POJgsIkroE6cQ0h4+xxHCJG2QlmcMlRi9+lfpFXeZ01at2q6nlqnUwwaDikjmGGP7JY12QO7Y0/s/ddada9Gy0uNZq2t5fbO0PF45u1fVZlmidKn6k/PEntY9rwK8m57TOsWeltfPTxtZpLrM/VZdsWeyf8la7B7uoFZfdWv1/j6GUL0APHv7f4JNhOx+GJsfi0RTS34TxHEBKYxR/1eQgqrSCPrdewE57gIvChjyqQy1U5VAr5mFF9CmfsAoK6N5g==</latexit> : Switching <latexit sha1_base64="STbwX0JctNkJ6BbUl3deVU11gUQ=">AAACbHichVG7SgNBFD1Z3/GR+CgEERaDYhVmo6hYCTYWFokaE4kiu+uoQ/bF7iYQgz9ga2GhFgoi4mfY+AMWfoIINgo2Ft7dLIgG9Q4zc+bMPXfOzGiOITyfsceY1NLa1t7R2RXv7untSyT7B9Y9u+LqPK/bhu0WNdXjhrB43he+wYuOy1VTM3hBKy8G+4Uqdz1hW2t+zeFbprpniV2hqz5RG/PysiIv2563nUyxNAtDbgZKBFKIImsnr7GJHdjQUYEJDgs+YQMqPGolKGBwiNtCnTiXkAj3OQ4RJ22FsjhlqMSWadyjVSliLVoHNb1QrdMpBnWXlDLG2QO7Ya/snt2yJ/bxa616WCPwUqNZa2i5s504Gl59/1dl0uxj/0v1p2cfu5gLvQry7oRMcAu9oa8enLyuzq+M1yfYJXsm/xfskd3RDazqm36V4yuniNMHKD+fuxmsZ9LKTHoql0ktTEdf0YkRjGGS3nsWC1hCFnk618QxznAee5GGpBFptJEqxSLNIL6FNPEJZ8aMYA==</latexit> : L1 Loss <latexit sha1_base64="9GNKpnBC+eKv3RoIfsTQSWAyk5Y=">AAACa3ichVG7SgNBFD1Z3/GRqI2oRTBErJabEE1iJWhh6SsmEEV210lc3Owuu5uABn/A0sZCGwUR8TNs/AELP0HESsHGwptJRCzUu8zOmTP33DlzR3ct0w+IHkNKR2dXd09vX7h/YHAoEh0e2fSdmmeIvOFYjlfUNV9Ypi3ygRlYouh6Qqvqlijo+4vN/UJdeL7p2BvBgSu2q1rFNsumoQVMFZdqngQ70TiplMmkUtkYqbO5TJbSEuTmchRLqiQjjnasONFrbGEXDgzUUIWAjYCxBQ0+fyUkQXCZ20aDOY+RKfcFjhBmbY2zBGdozO7zv8KrUpu1ed2s6Uu1wadYPDxWxpCgB7qhV7qnW3qij19rNWSNppcDnvWWVrg7keOx9fd/VVWeA+x9q/70HKCMrPRqsndXMs1bGC19/fD0dX1+LdGYpkt6Zv8X9Eh3fAO7/mZcrYq1M4T5Ab66HPsdbKbU5JyaXk3FF9Ltp+jFBKYww/3OYAHLWEFe9vkEZzgPvSijyrgy2UpVQm3NKH6EkvgEXKGNZg==</latexit> Duration <latexit sha1_base64="JH2fKYGtMHyK9GOrF+WhXzM5hpc=">AAACbHichVFNS1tBFD15WpumrUlbF4IUgiGhq8dNSE3SleCmy2hMVGwI7z3HOPi+eG8SiKF/oFsXLrSLFoqIP8ONf8BFfoIU3ETopovevESkC/UOM/fOmXvuPTNj+rYMFdEgpk1NP5t5Hn+RePnq9Wwy9eZtI/Q6gSXqlmd7waZphMKWrqgrqWyx6QfCcExbbJj7K6Pzja4IQum566rni6ZjtF25Ky1DMbRVDcSOtJQXtFIZ0qlUKhTKadI/VkplKkZBZalC6bxOkWUwsaqXOsUX7MCDhQ4cCLhQHNswEPLYRh4En7Em+owFHMnoXOArEsztcJbgDIPRfV7bvNueoC7vRzXDiG1xF5tnwMw0snRFZzSkSzqna/r7YK1+VGOkpcfeHHOF30p+m6/9eZLlsFfYu2c9qllhF+VIq2TtfoSMbmGN+d2Do2Ht01q2n6Of9Jv1/6ABXfAN3O6t9WtVrB0jwR9w98rph4NGQc8v6cXVQma5OPmKOBawiA/83iUs4zOqqHNfB4c4wffYjTanLWjvx6labMJ5h/9My/0DUT2N1g==</latexit> Predictor
  11. Speech corpora with a sampling frequency of 24 kHz Japanese

    female corpus JAF001: about 21.8 h (will soon be released by NICT) Japanese male corpus JAM017: about 20.7 h (will soon be released by NICT) Japanese multi-speaker corpus JVS: about 25.7 hours with 98 speakers for unseen speaker synthesis Neural vocoders Multi-band MelGAN HiFi-GAN V1 and V2 (a): Transposed convolution (b): Interpolation + convolution (c): Sub-pixel convolution (pixel-suf fl er) Sub-DiffWave with 10 sub models and 25 iterations Multi-stream MelGAN Multi-steam HiFi-GAN with sub-pixel convolution Experimental conditions 11
  12. Results of real-time factors 12 <latexit sha1_base64="MobdNZ20tbnWywbKlBLnoo5/9LU=">AAACZHichVG7SgNBFD1ZXzG+okEQBAkGxSrcVVGxEmwsTWKioCK766iD+2J3E9DgD2irWFgpiIifYeMPWOQHBLGMYGPhzWZBVNQ7zMyZM/fcOTOju6b0A6JaTGlpbWvviHcmurp7evuS/QMl3yl7higajul4a7rmC1PaohjIwBRrric0SzfFqr6/2NhfrQjPl469Ehy4YtPSdm25Iw0tYCqnbiUzlKUw0j+BGoEMolh2kjfYwDYcGCjDgoCNgLEJDT63dagguMxtosqcx0iG+wJHSLC2zFmCMzRm93nc5dV6xNq8btT0Q7XBp5jcPVamMUaPdEt1eqA7eqb3X2tVwxoNLwc8602tcLf6jocKb/+qLJ4D7H2q/vQcYAdzoVfJ3t2QadzCaOorh+f1wnx+rDpOV/TC/i+pRvd8A7vyalznRP4CCf4A9ftz/wSlyaw6k53KTWYWpqOviGMYo5jg957FApawjCKfK3CCU5zFnpRuJaUMNlOVWKRJ4UsoIx9mEomp</latexit> 1 <latexit sha1_base64="MobdNZ20tbnWywbKlBLnoo5/9LU=">AAACZHichVG7SgNBFD1ZXzG+okEQBAkGxSrcVVGxEmwsTWKioCK766iD+2J3E9DgD2irWFgpiIifYeMPWOQHBLGMYGPhzWZBVNQ7zMyZM/fcOTOju6b0A6JaTGlpbWvviHcmurp7evuS/QMl3yl7higajul4a7rmC1PaohjIwBRrric0SzfFqr6/2NhfrQjPl469Ehy4YtPSdm25Iw0tYCqnbiUzlKUw0j+BGoEMolh2kjfYwDYcGCjDgoCNgLEJDT63dagguMxtosqcx0iG+wJHSLC2zFmCMzRm93nc5dV6xNq8btT0Q7XBp5jcPVamMUaPdEt1eqA7eqb3X2tVwxoNLwc8602tcLf6jocKb/+qLJ4D7H2q/vQcYAdzoVfJ3t2QadzCaOorh+f1wnx+rDpOV/TC/i+pRvd8A7vyalznRP4CCf4A9ftz/wSlyaw6k53KTWYWpqOviGMYo5jg957FApawjCKfK3CCU5zFnpRuJaUMNlOVWKRJ4UsoIx9mEomp</latexit>

    1 <latexit sha1_base64="6Aro6Ivi2FzGHt0CHU96lA3nlh4=">AAACYHichVHLSsNAFD2Nr1qrrboRdFEsFVdlUkXFVcGNyz7sA2opSZzW0DQJSVqoxR/QreLClYKI+Blu/AEX/QFBXFZw48LbNCBa1DvMzJkz99w5MyObmmo7jHV9wsjo2PiEfzIwFZyeCYUDs3nbaFoKzymGZlhFWbK5puo856iOxoumxaWGrPGCXN/p7xda3LJVQ99z2iYvN6SarlZVRXKISicq4SiLMzciw0D0QBRepIzwLfZxAAMKmmiAQ4dDWIMEm1oJIhhM4sroEGcRUt19jmMESNukLE4ZErF1Gmu0KnmsTut+TdtVK3SKRt0iZQQx9sTuWI89snv2wj5+rdVxa/S9tGmWB1puVkInC9n3f1UNmh0cfqn+9Oygii3Xq0reTZfp30IZ6FtHF73sdibWWWHX7JX8X7Eue6Ab6K035SbNM5cI0AeIP597GOQTcXEjvhZNrnsf4ccilrFKr72JJHaRQo5O5TjFGc59z0JQmB8kCj5PMYdvISx9AhJGiQU=</latexit> 2 <latexit sha1_base64="6Aro6Ivi2FzGHt0CHU96lA3nlh4=">AAACYHichVHLSsNAFD2Nr1qrrboRdFEsFVdlUkXFVcGNyz7sA2opSZzW0DQJSVqoxR/QreLClYKI+Blu/AEX/QFBXFZw48LbNCBa1DvMzJkz99w5MyObmmo7jHV9wsjo2PiEfzIwFZyeCYUDs3nbaFoKzymGZlhFWbK5puo856iOxoumxaWGrPGCXN/p7xda3LJVQ99z2iYvN6SarlZVRXKISicq4SiLMzciw0D0QBRepIzwLfZxAAMKmmiAQ4dDWIMEm1oJIhhM4sroEGcRUt19jmMESNukLE4ZErF1Gmu0KnmsTut+TdtVK3SKRt0iZQQx9sTuWI89snv2wj5+rdVxa/S9tGmWB1puVkInC9n3f1UNmh0cfqn+9Oygii3Xq0reTZfp30IZ6FtHF73sdibWWWHX7JX8X7Eue6Ab6K035SbNM5cI0AeIP597GOQTcXEjvhZNrnsf4ccilrFKr72JJHaRQo5O5TjFGc59z0JQmB8kCj5PMYdvISx9AhJGiQU=</latexit> 2 <latexit sha1_base64="/TtNv/61qPI3un+LBtNl4SnG0es=">AAACZHichVFNSwJBGH7cvswsLQmCICQxOsloUtFJ6NLRj/wAE9ndxlpcd5fdVTDpD9S16NCpICL6GV36Ax38A0F0NOjSodd1IUqqd5iZZ555n3eemZEMVbFsxroeYWR0bHzCO+mb8k/PBIKzcwVLb5oyz8u6qpslSbS4qmg8byu2ykuGycWGpPKiVN/u7xdb3LQUXdu12wavNMQDTakpsmgTlUlWgxEWY06Eh0HcBRG4kdaDt9jDPnTIaKIBDg02YRUiLGplxMFgEFdBhziTkOLscxzDR9omZXHKEImt03hAq7LLarTu17QctUynqNRNUoYRZU/sjvXYI7tnL+zj11odp0bfS5tmaaDlRjVwspB7/1fVoNnG4ZfqT882ath0vCrk3XCY/i3kgb51dNHLbWWjnRV2zV7J/xXrsge6gdZ6k28yPHsJH31A/OdzD4NCIhZfj61lEpFU0v0KLxaxjFV67w2ksIM08nQuxynOcO55FvxCSJgfpAoeVxPCtxCWPgFsEoms</latexit> 4 <latexit sha1_base64="/TtNv/61qPI3un+LBtNl4SnG0es=">AAACZHichVFNSwJBGH7cvswsLQmCICQxOsloUtFJ6NLRj/wAE9ndxlpcd5fdVTDpD9S16NCpICL6GV36Ax38A0F0NOjSodd1IUqqd5iZZ555n3eemZEMVbFsxroeYWR0bHzCO+mb8k/PBIKzcwVLb5oyz8u6qpslSbS4qmg8byu2ykuGycWGpPKiVN/u7xdb3LQUXdu12wavNMQDTakpsmgTlUlWgxEWY06Eh0HcBRG4kdaDt9jDPnTIaKIBDg02YRUiLGplxMFgEFdBhziTkOLscxzDR9omZXHKEImt03hAq7LLarTu17QctUynqNRNUoYRZU/sjvXYI7tnL+zj11odp0bfS5tmaaDlRjVwspB7/1fVoNnG4ZfqT882ath0vCrk3XCY/i3kgb51dNHLbWWjnRV2zV7J/xXrsge6gdZ6k28yPHsJH31A/OdzD4NCIhZfj61lEpFU0v0KLxaxjFV67w2ksIM08nQuxynOcO55FvxCSJgfpAoeVxPCtxCWPgFsEoms</latexit> 4 <latexit sha1_base64="c4neHgwr4fZDzvsARMkyhxWjH2A=">AAACZHichVFNSwJBGH7cvswsLQmCICQxOsloUdJJ6NLRj/wAE9ndxlpcd5fdVTDpD9S16NCpICL6GV36Ax38A0F0NOjSodd1IUqqd5iZZ555n3eemZEMVbFsxroeYWR0bHzCO+mb8k/PBIKzcwVLb5oyz8u6qpslSbS4qmg8byu2ykuGycWGpPKiVN/u7xdb3LQUXdu12wavNMQDTakpsmgTlUlWgxEWY06Eh0HcBRG4kdaDt9jDPnTIaKIBDg02YRUiLGplxMFgEFdBhziTkOLscxzDR9omZXHKEImt03hAq7LLarTu17QctUynqNRNUoYRZU/sjvXYI7tnL+zj11odp0bfS5tmaaDlRjVwspB7/1fVoNnG4ZfqT882akg6XhXybjhM/xbyQN86uujltrLRzgq7Zq/k/4p12QPdQGu9yTcZnr2Ejz4g/vO5h0EhEYtvxNYyiUhq3f0KLxaxjFV6702ksIM08nQuxynOcO55FvxCSJgfpAoeVxPCtxCWPgF0Eomw</latexit> 8 <latexit sha1_base64="c4neHgwr4fZDzvsARMkyhxWjH2A=">AAACZHichVFNSwJBGH7cvswsLQmCICQxOsloUdJJ6NLRj/wAE9ndxlpcd5fdVTDpD9S16NCpICL6GV36Ax38A0F0NOjSodd1IUqqd5iZZ555n3eemZEMVbFsxroeYWR0bHzCO+mb8k/PBIKzcwVLb5oyz8u6qpslSbS4qmg8byu2ykuGycWGpPKiVN/u7xdb3LQUXdu12wavNMQDTakpsmgTlUlWgxEWY06Eh0HcBRG4kdaDt9jDPnTIaKIBDg02YRUiLGplxMFgEFdBhziTkOLscxzDR9omZXHKEImt03hAq7LLarTu17QctUynqNRNUoYRZU/sjvXYI7tnL+zj11odp0bfS5tmaaDlRjVwspB7/1fVoNnG4ZfqT882akg6XhXybjhM/xbyQN86uujltrLRzgq7Zq/k/4p12QPdQGu9yTcZnr2Ejz4g/vO5h0EhEYtvxNYyiUhq3f0KLxaxjFV6702ksIM08nQuxynOcO55FvxCSJgfpAoeVxPCtxCWPgF0Eomw</latexit> 8 <latexit sha1_base64="J95joZp3MVw6DDGblo3xokKWKJg=">AAACZXichVHLSsNAFD2Nr1ofrQ9EcKFYFFflRqWKq4Ibl1ptFVQkidM6mCYhSQu1+APiVl24UhARP8ONP+DCLxBxWcGNC2/TgKiod5iZM2fuuXNmRndM6flEjxGlpbWtvSPaGevq7umNJ/r6855ddg2RM2zTdjd0zROmtETOl74pNhxXaCXdFOv6/mJjf70iXE/a1ppfdcR2SStasiANzWcqq6Z3EklKURBjP4EagiTCWLYT19jCLmwYKKMEAQs+YxMaPG6bUEFwmNtGjTmXkQz2BQ4RY22ZswRnaMzu81jk1WbIWrxu1PQCtcGnmNxdVo5hgh7ohup0T7f0TO+/1qoFNRpeqjzrTa1wduJHw6tv/6pKPPvY+1T96dlHAfOBV8nenYBp3MJo6isHZ/XVhexEbZIu6YX9X9Aj3fENrMqrcbUisueI8Qeo35/7J8hPp9R0amZlOpmZDb8iihGMY4rfew4ZLGEZOT63gGOc4DTypPQog8pQM1WJhJoBfAll9AP3o4np</latexit> 16 <latexit sha1_base64="J95joZp3MVw6DDGblo3xokKWKJg=">AAACZXichVHLSsNAFD2Nr1ofrQ9EcKFYFFflRqWKq4Ibl1ptFVQkidM6mCYhSQu1+APiVl24UhARP8ONP+DCLxBxWcGNC2/TgKiod5iZM2fuuXNmRndM6flEjxGlpbWtvSPaGevq7umNJ/r6855ddg2RM2zTdjd0zROmtETOl74pNhxXaCXdFOv6/mJjf70iXE/a1ppfdcR2SStasiANzWcqq6Z3EklKURBjP4EagiTCWLYT19jCLmwYKKMEAQs+YxMaPG6bUEFwmNtGjTmXkQz2BQ4RY22ZswRnaMzu81jk1WbIWrxu1PQCtcGnmNxdVo5hgh7ohup0T7f0TO+/1qoFNRpeqjzrTa1wduJHw6tv/6pKPPvY+1T96dlHAfOBV8nenYBp3MJo6isHZ/XVhexEbZIu6YX9X9Aj3fENrMqrcbUisueI8Qeo35/7J8hPp9R0amZlOpmZDb8iihGMY4rfew4ZLGEZOT63gGOc4DTypPQog8pQM1WJhJoBfAll9AP3o4np</latexit> 16 <latexit sha1_base64="ngc26A4wGyojTScDzKk3yJK/ZqI=">AAAClnichVFNTxQxGH4YAXH5WvRC4qVxA8EDmw4SMB4Mhhg5LgsLJEg2nW6Bhs50MtPZBDf+Af8AB0+aEGP8DZ5M1D/ggZ9gOELChQPvzk5ihKBv0/bp0/d5+7QNYqNTx/lJn3enf2Dw7tC90vDI6Nh4eeL+RmqzRKqGtMYmW4FIldGRajjtjNqKEyXCwKjN4GC5u7/ZVkmqbbTuDmO1E4q9SO9qKRxRzbI/8+IxqythZp0OFYtUlgjD2lbaFqmYiFpMSJulTksWEmdYs1zhVZ4Huwn8AlRQRM2WP+E1WrCQyBBCIYIjbCCQUtuGD46YuB10iEsI6Xxf4S1KpM0oS1GGIPaAxj1abRdsROtuzTRXSzrFUE9IyTDFf/HP/Iz/5F/4b355a61OXqPr5ZDmoKdVcXP83eTaxX9VIc0O+39U//TssIunuVdN3uOc6d5C9vTtN0dna8/qU51p/pGfkv8P/IR/oxtE7XN5vKrq71GiD/CvP/dNsDFX9ReqT1bnKkvzxVcM4SEeYYbeexFLWEENDTr3CF/xHT+8Se+599J71Uv1+grNA/wVXu0KwGmb5w==</latexit> (A) Real-time neural vocoders and acoustic model <latexit sha1_base64="AODZnP4POUJkti/BdD93lZKCv1w=">AAAClXichVHNalQxGD29/tXxp1NdtOAmOFTqZvhmlLYUhFJbcee0M9MWahlyr2kbmvtDbmbKdOgL+AC6cKVQRHwFd6L4Ai76COKyghsXfvfOBdGifiHJycl3vpwkfmJ06oiOR7wzZ8+dvzB6sXTp8pWrY+Xxa2tp3LWBagexie2GL1NldKTaTjujNhKrZOgbte7v3c/213vKpjqOWq6fqK1Q7kR6WwfSMdUp0/TibbEcOW2VaLWaIu2nToViX7td0ZBWGqOMaMkgdjaORF2UOuUKVSkPcRrUClBBEY24/BqP8QQxAnQRQiGCY2wgkXLbRA2EhLktDJizjHS+r3CIEmu7nKU4QzK7x+MOrzYLNuJ1VjPN1QGfYrhbVgpM0Wd6Qyf0id7SF/rx11qDvEbmpc+zP9SqpDP2dLL5/b+qkGeH3V+qf3p22MZc7lWz9yRnslsEQ33v4PlJc351anCLXtFX9v+Sjuk93yDqfQuOVtTqC2QfUPvzuU+DtXq1NlO9s1KvLNwtvmIUN3AT0/zes1jAQzTQ5nOf4R0+4KM34d3zlrwHw1RvpNBcx2/hPfoJ2KuaiQ==</latexit> (B) Entire TTS system with Parallel Tacotron 2 Successfully accelerate inference speed than HiFi-GAN V1
  13. Results of MOS tests 13 <latexit sha1_base64="8xGc4yu7C9knruLiLMbmjG0oBgk=">AAACd3ichVHLSsNAFD2Nr1ofrboRXFgsFVdlUkHFVcGNG9G2tgpVShKndWiahCQt1uIP+AMuBEFBqvgZbvwBF/0EcVlBBBfepgFRUW/IzLln7rlzZka1dOG4jLUDUl//wOBQcDg0Mjo2Ho5MTOYds2ZrPKeZumnvqorDdWHwnCtcne9aNleqqs531Mpad32nzm1HmMa227D4flUpG6IkNMUlqhiZ3OCKEd20hEFpNKuZNi9GYizBvIj+BLIPYvBjy4y0sIcDmNBQQxUcBlzCOhQ49BUgg8Eibh9N4mxCwlvnOEGItDWq4lShEFuhsUxZwWcNyrs9HU+t0S46/TYpo4izR3bLOuyB3bEn9v5rr6bXo+ulQbPa03KrGD6dzr7+q6rS7OLwU/WnZxclrHheBXm3PKZ7Cq2nrx+fdbKrmXhznl2xZ/J/ydrsnk5g1F+06zTPnCNEDyB/v+6fIJ9MyEuJxXQylkr6TxHEDOawQPe9jBTWsYUc7XuEC7RwE3iTZqV5aaFXKgV8zRS+hCR/AHB0kOo=</latexit> Mean Opinion Score

    <latexit sha1_base64="f7iIC+etmqbWedTAcddRKc8jMWE=">AAACd3ichVHLSgMxFD0dX7U+WutGcKFYFDeWTAUVVxU3LuujWqhSZsaowenMMEmLtfgD/oALQVCQKn6GG3/AhZ8gLhVEcOHtdEBU1BuSnJzcc3OSmJ4tpGLsIaK1tXd0dkW7Yz29ff3xxEByXboV3+J5y7Vdv2AaktvC4XkllM0Lns+NsmnzDXN/sbm/UeW+FK6zpmoe3yobu47YEZahiColkguOYdekkFOy5qg9TqiUSLE0C2L0J9BDkEIYOTfRwCa24cJCBWVwOFCEbRiQ1IrQweARt4U6cT4hEexzHCFG2gplccowiN2ncZdWxZB1aN2sKQO1RafY1H1SjmKc3bNr9szu2A17ZO+/1qoHNZpeajSbLS33SvHjodXXf1VlmhX2PlV/elbYwVzgVZB3L2Cat7Ba+urhyfPq/Mp4fYJdsCfyf84e2C3dwKm+WJfLfOUUMfoA/ftz/wTrmbQ+k55ezqSymfArohjGGCbpvWeRxRJyyNO5BzhDA1eRN21Em9AmW6laJNQM4kto+gf6wZGs</latexit> Analysis-synthesis <latexit sha1_base64="i8oC6Eoyg1vzBO78osamMLUMvws=">AAACcXichVHLSgMxFD0d3/VVdaO4KRZFkJZMBRVXghuXrbYq+CgzY6zBeTGTFrX4A/6AgqsWRMTPcOMPuOgniMsKblx4ZzogKuoNSU5O7rk5SXTXFL5krBlTOjq7unt6++L9A4NDw4mR0U3fqXgGLxqO6XjbuuZzU9i8KIU0+bbrcc3STb6lH68G+1tV7vnCsQvy1OV7lla2xaEwNEnUfoGfyLR00r7LuXFUSqRYhoWR/AnUCKQQRc5J3GIXB3BgoAILHDYkYRMafGo7UMHgEreHGnEeIRHuc5wjTtoKZXHK0Ig9prFMq52ItWkd1PRDtUGnmNQ9UiYxzZ7YHWuxR3bPntn7r7VqYY3AyynNelvL3dLwxfjG278qi2aJo0/Vn54lDrEUehXk3Q2Z4BZGW189u2xtLK9P12ZYg72Q/zprsge6gV19NW7yfP0acfoA9ftz/wSb2Yy6kJnPZ1Mr2egrejGJKczSey9iBWvIoUjnerhCHY1YS5lQkspUO1WJRZoxfAll7gPA/49S</latexit> Text-to-speech <latexit sha1_base64="guWMsHPtOX6S96L+joHwJ5Ks0mI=">AAACe3ichVHLSgMxFD0dX7U+WhVEcFMsioqWtOIDV4IbN4KvqqBSZsarhk5nhpm0oNUf8AdcuFIQEf0LN/6ACz9BXCq4UfB2OiAq6g1JTk7uuTlJDNeSvhLiIaLV1Tc0NkWbYy2tbe3xREfnqu+UPJNypmM53rqh+2RJm3JKKovWXY/0omHRmlGYre6vlcnzpWOvqH2Xtor6ri13pKkrpvKJ7vmSpeSo75JeIC85mLN9Inson0iJtAgi+RNkQpBCGAtO4hKb2IYDEyUUQbChGFvQ4XPbQAYCLnNbqDDnMZLBPuEIMdaWOIs4Q2e2wOMurzZC1uZ1taYfqE0+xeLusTKJfnEvrsSzuBPX4lG8/VqrEtSoetnn2ahpyc3Hj3uWX/9VFXlW2PtU/elZYQdTgVfJ3t2Aqd7CrOnLByfPy9NL/ZUBcS6e2P+ZeBC3fAO7/GJeLNLSKWL8AZnvz/0TrGbTmYn02GI2NZMNvyKKXvRhkN97EjOYwwJyfO4hznGNm8i7ltKGtZFaqhYJNV34Etr4B/mbkns=</latexit> Multi-speaker (Unseen) <latexit sha1_base64="T/qVmaaQeLcw81IcQm0za/CxMjY=">AAACaXichVFNLwNBGH66vuujLZeGi2gqTs20EsSJOHAhbWlJqpHdNa3R7e5md9qExh9wchOcSETEz3DxBxz8BHEkcXHwdruJ0OCdzMwzz7zPO8/MaLYhXMnYU0Dp6Ozq7untC/YPDA6FwpHhvGvVHJ3ndMuwnC1NdbkhTJ6TQhp8y3a4WtUMvqlVlpr7m3XuuMIyN+SBzYtVtWyKktBVSVR+lRvLi2s74RhLMC/G20HSBzH4kbbCN9jGLizoqKEKDhOSsAEVLrUCkmCwiSuiQZxDSHj7HEcIkrZGWZwyVGIrNJZpVfBZk9bNmq6n1ukUg7pDynHE2SO7Za/sgd2xZ/bxa62GV6Pp5YBmraXl9k7oOLr+/q+qSrPE3pfqT88SJcx5XgV5tz2meQu9pa8fnr6uz2fjjUl2xV7I/yV7Yvd0A7P+pl9nePYCQfqA5M/nbgf5VCI5k5jOpGILKf8rejGGCUzRe89iAStII0fn7uMEZzgPvCgRJaqMtlKVgK8ZwbdQYp+r0Iuc</latexit> MelGAN <latexit sha1_base64="OqPqwiQtHKyWJfI+h+yTigHYNro=">AAACa3ichVHLSsNAFD2Nr1ofrboRdVEsFTeWaQUVVxVBu5JW7QO0lCSOOjRNQpIWavEHXLpxoRsFEfEz3PgDLvoJIq4quHHhbRoQFfWGyZw5c8+dM3cUUxO2w1jTJ3V19/T2+fsDA4NDw8HQyGjONqqWyrOqoRlWQZFtrgmdZx3haLxgWlyuKBrPK+XV9n6+xi1bGPq2Uzd5sSIf6GJfqLJDVCEl1sTc+spGKRRhMeZG+CeIeyACL9JG6Aa72IMBFVVUwKHDIaxBhk3fDuJgMIkrokGcRUi4+xzHCJC2SlmcMmRiy/Q/oNWOx+q0bte0XbVKp2g0LFKGEWWP7Ja12AO7Y0/s/ddaDbdG20udZqWj5WYpeDK+9favqkKzg8NP1Z+eHexjyfUqyLvpMu1bqB197eistbW8GW3MsCv2TP4vWZPd0w302qt6neGb5wjQA8S/t/snyCVi8YXYfCYRSSa8p/BjEtOYpX4vIokU0si6fT7FOS58L9KYNCFNdVIln6cZw5eQoh/YU4wf</latexit> HiFi-GAN <latexit sha1_base64="Om/0rlD4Jzk1bZN6Eg6GE6gJvjk=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVaQUVVwU3boQ+7ANqKUmc1tA0CUlaqMUfELfqwpWCiPgZbvwBF/0CEZcV3LjwNg2IFvUOM3PmzD13zsxIhqpYNmMdjzA0PDI65h33TUz6pwLB6ZmcpTdMmWdlXdXNgiRaXFU0nrUVW+UFw+RiXVJ5Xqpt9/bzTW5aiq7t2S2Dl+piVVMqiizaRKV3M+VgmEWZE6FBEHNBGG4k9eAt9nEAHTIaqINDg01YhQiLWhExMBjEldAmziSkOPscx/CRtkFZnDJEYms0VmlVdFmN1r2alqOW6RSVuknKECLsid2xLntk9+yFffxaq+3U6Hlp0Sz1tdwoB04WMu//quo02zj8Uv3p2UYFm45XhbwbDtO7hdzXN48uupmtdKS9wq7ZK/m/Yh32QDfQmm/yTYqnL+GjD4j9fO5BkItHY+vRtVQ8nIi7X+HFIpaxSu+9gQR2kESWzq3gFGc49zwLfmFOmO+nCh5XM4tvISx9Amk0iiA=</latexit> MS <latexit sha1_base64="wRi80747asQGAT8xlmPgI3PJnA0=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVSQUVVwU3LvuwD6ilJHGqoWkSkrRQiz8gbtWFKwUR8TPc+AMu+gUiLiu4ceFtGhAt6h1m5syZe+6cmZFNTbUdxjo+YWh4ZHTMPx6YmAxOhcLTM3nbaFgKzymGZlhFWbK5puo856iOxoumxaW6rPGCXNvu7Rea3LJVQ991WiYv16UDXa2qiuQQlcmLlXCUxZkbkUEgeiAKL1JG+BZ72IcBBQ3UwaHDIaxBgk2tBBEMJnFltImzCKnuPscxAqRtUBanDInYGo0HtCp5rE7rXk3bVSt0ikbdImUEMfbE7liXPbJ79sI+fq3Vdmv0vLRolvtablZCJwvZ939VdZodHH6p/vTsoIpN16tK3k2X6d1C6eubRxfd7FYm1l5h1+yV/F+xDnugG+jNN+UmzTOXCNAHiD+fexDkE3FxPb6WTkSTCe8r/FjEMlbpvTeQxA5SyNG5VZziDOe+ZyEozAnz/VTB52lm8S2EpU83PYoH</latexit> V1 <latexit sha1_base64="wRi80747asQGAT8xlmPgI3PJnA0=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVSQUVVwU3LvuwD6ilJHGqoWkSkrRQiz8gbtWFKwUR8TPc+AMu+gUiLiu4ceFtGhAt6h1m5syZe+6cmZFNTbUdxjo+YWh4ZHTMPx6YmAxOhcLTM3nbaFgKzymGZlhFWbK5puo856iOxoumxaW6rPGCXNvu7Rea3LJVQ991WiYv16UDXa2qiuQQlcmLlXCUxZkbkUEgeiAKL1JG+BZ72IcBBQ3UwaHDIaxBgk2tBBEMJnFltImzCKnuPscxAqRtUBanDInYGo0HtCp5rE7rXk3bVSt0ikbdImUEMfbE7liXPbJ79sI+fq3Vdmv0vLRolvtablZCJwvZ939VdZodHH6p/vTsoIpN16tK3k2X6d1C6eubRxfd7FYm1l5h1+yV/F+xDnugG+jNN+UmzTOXCNAHiD+fexDkE3FxPb6WTkSTCe8r/FjEMlbpvTeQxA5SyNG5VZziDOe+ZyEozAnz/VTB52lm8S2EpU83PYoH</latexit> V1 <latexit sha1_base64="wRi80747asQGAT8xlmPgI3PJnA0=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVSQUVVwU3LvuwD6ilJHGqoWkSkrRQiz8gbtWFKwUR8TPc+AMu+gUiLiu4ceFtGhAt6h1m5syZe+6cmZFNTbUdxjo+YWh4ZHTMPx6YmAxOhcLTM3nbaFgKzymGZlhFWbK5puo856iOxoumxaW6rPGCXNvu7Rea3LJVQ991WiYv16UDXa2qiuQQlcmLlXCUxZkbkUEgeiAKL1JG+BZ72IcBBQ3UwaHDIaxBgk2tBBEMJnFltImzCKnuPscxAqRtUBanDInYGo0HtCp5rE7rXk3bVSt0ikbdImUEMfbE7liXPbJ79sI+fq3Vdmv0vLRolvtablZCJwvZ939VdZodHH6p/vTsoIpN16tK3k2X6d1C6eubRxfd7FYm1l5h1+yV/F+xDnugG+jNN+UmzTOXCNAHiD+fexDkE3FxPb6WTkSTCe8r/FjEMlbpvTeQxA5SyNG5VZziDOe+ZyEozAnz/VTB52lm8S2EpU83PYoH</latexit> V1 <latexit sha1_base64="y3EJvU+5mZ1gdperGZSuV9a0GDE=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVSQUVVwU3LvuwD6ilJHGqoWkSkrRQiz8gbtWFKwUR8TPc+AMu+gUiLiu4ceFtGhAt6h1m5syZe+6cmZFNTbUdxjo+YWh4ZHTMPx6YmAxOhcLTM3nbaFgKzymGZlhFWbK5puo856iOxoumxaW6rPGCXNvu7Rea3LJVQ991WiYv16UDXa2qiuQQlcknKuEoizM3IoNA9EAUXqSM8C32sA8DChqog0OHQ1iDBJtaCSIYTOLKaBNnEVLdfY5jBEjboCxOGRKxNRoPaFXyWJ3WvZq2q1boFI26RcoIYuyJ3bEue2T37IV9/Fqr7dboeWnRLPe13KyEThay7/+q6jQ7OPxS/enZQRWbrleVvJsu07uF0tc3jy662a1MrL3Crtkr+b9iHfZAN9Cbb8pNmmcuEaAPEH8+9yDIJ+LienwtnYgmE95X+LGIZazSe28giR2kkKNzqzjFGc59z0JQmBPm+6mCz9PM4lsIS585PYoI</latexit> V2 <latexit sha1_base64="y3EJvU+5mZ1gdperGZSuV9a0GDE=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVSQUVVwU3LvuwD6ilJHGqoWkSkrRQiz8gbtWFKwUR8TPc+AMu+gUiLiu4ceFtGhAt6h1m5syZe+6cmZFNTbUdxjo+YWh4ZHTMPx6YmAxOhcLTM3nbaFgKzymGZlhFWbK5puo856iOxoumxaW6rPGCXNvu7Rea3LJVQ991WiYv16UDXa2qiuQQlcknKuEoizM3IoNA9EAUXqSM8C32sA8DChqog0OHQ1iDBJtaCSIYTOLKaBNnEVLdfY5jBEjboCxOGRKxNRoPaFXyWJ3WvZq2q1boFI26RcoIYuyJ3bEue2T37IV9/Fqr7dboeWnRLPe13KyEThay7/+q6jQ7OPxS/enZQRWbrleVvJsu07uF0tc3jy662a1MrL3Crtkr+b9iHfZAN9Cbb8pNmmcuEaAPEH8+9yDIJ+LienwtnYgmE95X+LGIZazSe28giR2kkKNzqzjFGc59z0JQmBPm+6mCz9PM4lsIS585PYoI</latexit> V2 <latexit sha1_base64="wRi80747asQGAT8xlmPgI3PJnA0=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVSQUVVwU3LvuwD6ilJHGqoWkSkrRQiz8gbtWFKwUR8TPc+AMu+gUiLiu4ceFtGhAt6h1m5syZe+6cmZFNTbUdxjo+YWh4ZHTMPx6YmAxOhcLTM3nbaFgKzymGZlhFWbK5puo856iOxoumxaW6rPGCXNvu7Rea3LJVQ991WiYv16UDXa2qiuQQlcmLlXCUxZkbkUEgeiAKL1JG+BZ72IcBBQ3UwaHDIaxBgk2tBBEMJnFltImzCKnuPscxAqRtUBanDInYGo0HtCp5rE7rXk3bVSt0ikbdImUEMfbE7liXPbJ79sI+fq3Vdmv0vLRolvtablZCJwvZ939VdZodHH6p/vTsoIpN16tK3k2X6d1C6eubRxfd7FYm1l5h1+yV/F+xDnugG+jNN+UmzTOXCNAHiD+fexDkE3FxPb6WTkSTCe8r/FjEMlbpvTeQxA5SyNG5VZziDOe+ZyEozAnz/VTB52lm8S2EpU83PYoH</latexit> V1 <latexit sha1_base64="wRi80747asQGAT8xlmPgI3PJnA0=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVSQUVVwU3LvuwD6ilJHGqoWkSkrRQiz8gbtWFKwUR8TPc+AMu+gUiLiu4ceFtGhAt6h1m5syZe+6cmZFNTbUdxjo+YWh4ZHTMPx6YmAxOhcLTM3nbaFgKzymGZlhFWbK5puo856iOxoumxaW6rPGCXNvu7Rea3LJVQ991WiYv16UDXa2qiuQQlcmLlXCUxZkbkUEgeiAKL1JG+BZ72IcBBQ3UwaHDIaxBgk2tBBEMJnFltImzCKnuPscxAqRtUBanDInYGo0HtCp5rE7rXk3bVSt0ikbdImUEMfbE7liXPbJ79sI+fq3Vdmv0vLRolvtablZCJwvZ939VdZodHH6p/vTsoIpN16tK3k2X6d1C6eubRxfd7FYm1l5h1+yV/F+xDnugG+jNN+UmzTOXCNAHiD+fexDkE3FxPb6WTkSTCe8r/FjEMlbpvTeQxA5SyNG5VZziDOe+ZyEozAnz/VTB52lm8S2EpU83PYoH</latexit> V1 <latexit sha1_base64="wRi80747asQGAT8xlmPgI3PJnA0=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVSQUVVwU3LvuwD6ilJHGqoWkSkrRQiz8gbtWFKwUR8TPc+AMu+gUiLiu4ceFtGhAt6h1m5syZe+6cmZFNTbUdxjo+YWh4ZHTMPx6YmAxOhcLTM3nbaFgKzymGZlhFWbK5puo856iOxoumxaW6rPGCXNvu7Rea3LJVQ991WiYv16UDXa2qiuQQlcmLlXCUxZkbkUEgeiAKL1JG+BZ72IcBBQ3UwaHDIaxBgk2tBBEMJnFltImzCKnuPscxAqRtUBanDInYGo0HtCp5rE7rXk3bVSt0ikbdImUEMfbE7liXPbJ79sI+fq3Vdmv0vLRolvtablZCJwvZ939VdZodHH6p/vTsoIpN16tK3k2X6d1C6eubRxfd7FYm1l5h1+yV/F+xDnugG+jNN+UmzTOXCNAHiD+fexDkE3FxPb6WTkSTCe8r/FjEMlbpvTeQxA5SyNG5VZziDOe+ZyEozAnz/VTB52lm8S2EpU83PYoH</latexit> V1 <latexit sha1_base64="y3EJvU+5mZ1gdperGZSuV9a0GDE=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVSQUVVwU3LvuwD6ilJHGqoWkSkrRQiz8gbtWFKwUR8TPc+AMu+gUiLiu4ceFtGhAt6h1m5syZe+6cmZFNTbUdxjo+YWh4ZHTMPx6YmAxOhcLTM3nbaFgKzymGZlhFWbK5puo856iOxoumxaW6rPGCXNvu7Rea3LJVQ991WiYv16UDXa2qiuQQlcknKuEoizM3IoNA9EAUXqSM8C32sA8DChqog0OHQ1iDBJtaCSIYTOLKaBNnEVLdfY5jBEjboCxOGRKxNRoPaFXyWJ3WvZq2q1boFI26RcoIYuyJ3bEue2T37IV9/Fqr7dboeWnRLPe13KyEThay7/+q6jQ7OPxS/enZQRWbrleVvJsu07uF0tc3jy662a1MrL3Crtkr+b9iHfZAN9Cbb8pNmmcuEaAPEH8+9yDIJ+LienwtnYgmE95X+LGIZazSe28giR2kkKNzqzjFGc59z0JQmBPm+6mCz9PM4lsIS585PYoI</latexit> V2 <latexit sha1_base64="3vxE8cDnkU9AYpgmlnQ8mW4vie4=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxKK7KtIKKq6IbN0If9gG1lCROa2iahCQt1OIPiFt14UpBRPwMN/6Ai36BiMsKblx4mwZEi3qHmTlz5p47Z2YkQ1Usm7G2RxgYHBoe8Y76xsb9E4Hg5FTW0uumzDOyrupmXhItrioaz9iKrfK8YXKxJqk8J1W3u/u5BjctRdf27KbBizWxoillRRZtolK7W6VgmEWYE6F+EHVBGG4k9OAt9nEAHTLqqIFDg01YhQiLWgFRMBjEFdEiziSkOPscx/CRtk5ZnDJEYqs0VmhVcFmN1t2alqOW6RSVuknKEJbYE7tjHfbI7tkL+/i1Vsup0fXSpFnqablRCpzMpd//VdVotnH4pfrTs40yNhyvCnk3HKZ7C7mnbxxddNKbqaXWMrtmr+T/irXZA91Aa7zJN0meuoSPPiD687n7QTYWia5FVpOxcDzmfoUX81jECr33OuLYQQIZOreMU5zh3PMs+IUZYbaXKnhczTS+hbDwCUc0ig8=</latexit> MB <latexit sha1_base64="Om/0rlD4Jzk1bZN6Eg6GE6gJvjk=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVaQUVVwU3boQ+7ANqKUmc1tA0CUlaqMUfELfqwpWCiPgZbvwBF/0CEZcV3LjwNg2IFvUOM3PmzD13zsxIhqpYNmMdjzA0PDI65h33TUz6pwLB6ZmcpTdMmWdlXdXNgiRaXFU0nrUVW+UFw+RiXVJ5Xqpt9/bzTW5aiq7t2S2Dl+piVVMqiizaRKV3M+VgmEWZE6FBEHNBGG4k9eAt9nEAHTIaqINDg01YhQiLWhExMBjEldAmziSkOPscx/CRtkFZnDJEYms0VmlVdFmN1r2alqOW6RSVuknKECLsid2xLntk9+yFffxaq+3U6Hlp0Sz1tdwoB04WMu//quo02zj8Uv3p2UYFm45XhbwbDtO7hdzXN48uupmtdKS9wq7ZK/m/Yh32QDfQmm/yTYqnL+GjD4j9fO5BkItHY+vRtVQ8nIi7X+HFIpaxSu+9gQR2kESWzq3gFGc49zwLfmFOmO+nCh5XM4tvISx9Amk0iiA=</latexit> MS <latexit sha1_base64="07zVMyowNKXxwYJbMjNYRyMeWs0=">AAACa3ichVG7SgNBFD1Z3/GRaBpRCzFErMJsBBWrgI2d0RgNqMjuOsYhk91ldxLQ4A9Y2ljERkFE/Awbf8AinyBipWBj4c1mQVTUu8zOmTP33Dlzx3Sl8BVjzYjW0dnV3dPbF+0fGByKxYdHNnyn6lm8YDnS8Yqm4XMpbF5QQkledD1uVEzJN83yUmt/s8Y9Xzj2ujp0+U7FKNliX1iGIqq44omSsA25G0+yNAti8ifQQ5BEGDknfo1t7MGBhSoq4LChCEsY8Onbgg4Gl7gd1InzCIlgn+MYUdJWKYtThkFsmf4lWm2FrE3rVk0/UFt0iqThkXISKfbAbtgLu2e37JG9/1qrHtRoeTmk2WxrubsbOxnNv/2rqtCscPCp+tOzwj4WAq+CvLsB07qF1dbXjs5e8otrqfo0u2RP5P+CNdkd3cCuvVpXq3ytgSg9gP693T/BRiatz6VnVzPJbCZ8il6MYwoz1O95ZLGMHApBn0/RwHnkWUtoY9pEO1WLhJoEvoSW+gB+oYzx</latexit> Original <latexit sha1_base64="751oLtXmWmcdLjZQCdE1HvJEn9M=">AAACZXichVFNSwJBGH7cvswy7YMIOiRJ0UlGg4pOQhAd/VYwkd1ttMV1d9ldBZP+QHStDp0KIqKf0aU/0MFfENHRoEuHXteFKKneYWaeeeZ93nlmRjJUxbIZ63iEoeGR0THvuG9i0j8VCE7P5Cy9Yco8K+uqbhYk0eKqovGsrdgqLxgmF+uSyvNSbae3n29y01J0LWO3DF6qi1VNqSiyaBOVyuyWg2EWYU6EBkHUBWG4kdCDt9jHAXTIaKAODg02YRUiLGpFRMFgEFdCmziTkOLscxzDR9oGZXHKEImt0VilVdFlNVr3alqOWqZTVOomKUNYYU/sjnXZI7tnL+zj11ptp0bPS4tmqa/lRjlwspB+/1dVp9nG4ZfqT882KthyvCrk3XCY3i3kvr55dNFNb6dW2qvsmr2S/yvWYQ90A635Jt8keeoSPvqA6M/nHgS5WCS6EVlPxsLxmPsVXixiGWv03puIYw8JZOncCk5xhnPPs+AX5oT5fqrgcTWz+BbC0iddO4oa</latexit> TF <latexit sha1_base64="z1CbqLFsJiWfw/nZ1PRUxQUrwi8=">AAACZnichVHLSsNAFD2Nr1ofrYoouCmWiqsyqaDiquDGZd8t1FKSOK2haRKStFCLPyC4tQtXCiLiZ7jxB1z0DxSXFdy48DYNiBb1DjNz5sw9d87MyKam2g5jPZ8wNj4xOeWfDszMzs0HQwuLedtoWgrPKYZmWEVZsrmm6jznqI7Gi6bFpYas8YJc3x/sF1rcslVDzzptk5cbUk1Xq6oiOURlktl4JRRhMeZGeBSIHojAi6QRusUhjmBAQRMNcOhwCGuQYFMrQQSDSVwZHeIsQqq7z3GKAGmblMUpQyK2TmONViWP1Wk9qGm7aoVO0ahbpAwjyp7YHeuzR3bPXtjHr7U6bo2BlzbN8lDLzUrwbDXz/q+qQbOD4y/Vn54dVLHrelXJu+kyg1soQ33rpNvP7KWjnQ12zV7J/xXrsQe6gd56U25SPH2JAH2A+PO5R0E+HhO3Y1upeCQR977CjzWsY5PeewcJHCCJHJ1bwzku0PU9C/PCsrAyTBV8nmYJ30IIfwL7PYpg</latexit> PT2 <latexit sha1_base64="Om/0rlD4Jzk1bZN6Eg6GE6gJvjk=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVaQUVVwU3boQ+7ANqKUmc1tA0CUlaqMUfELfqwpWCiPgZbvwBF/0CEZcV3LjwNg2IFvUOM3PmzD13zsxIhqpYNmMdjzA0PDI65h33TUz6pwLB6ZmcpTdMmWdlXdXNgiRaXFU0nrUVW+UFw+RiXVJ5Xqpt9/bzTW5aiq7t2S2Dl+piVVMqiizaRKV3M+VgmEWZE6FBEHNBGG4k9eAt9nEAHTIaqINDg01YhQiLWhExMBjEldAmziSkOPscx/CRtkFZnDJEYms0VmlVdFmN1r2alqOW6RSVuknKECLsid2xLntk9+yFffxaq+3U6Hlp0Sz1tdwoB04WMu//quo02zj8Uv3p2UYFm45XhbwbDtO7hdzXN48uupmtdKS9wq7ZK/m/Yh32QDfQmm/yTYqnL+GjD4j9fO5BkItHY+vRtVQ8nIi7X+HFIpaxSu+9gQR2kESWzq3gFGc49zwLfmFOmO+nCh5XM4tvISx9Amk0iiA=</latexit> MS <latexit sha1_base64="wRi80747asQGAT8xlmPgI3PJnA0=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVSQUVVwU3LvuwD6ilJHGqoWkSkrRQiz8gbtWFKwUR8TPc+AMu+gUiLiu4ceFtGhAt6h1m5syZe+6cmZFNTbUdxjo+YWh4ZHTMPx6YmAxOhcLTM3nbaFgKzymGZlhFWbK5puo856iOxoumxaW6rPGCXNvu7Rea3LJVQ991WiYv16UDXa2qiuQQlcmLlXCUxZkbkUEgeiAKL1JG+BZ72IcBBQ3UwaHDIaxBgk2tBBEMJnFltImzCKnuPscxAqRtUBanDInYGo0HtCp5rE7rXk3bVSt0ikbdImUEMfbE7liXPbJ79sI+fq3Vdmv0vLRolvtablZCJwvZ939VdZodHH6p/vTsoIpN16tK3k2X6d1C6eubRxfd7FYm1l5h1+yV/F+xDnugG+jNN+UmzTOXCNAHiD+fexDkE3FxPb6WTkSTCe8r/FjEMlbpvTeQxA5SyNG5VZziDOe+ZyEozAnz/VTB52lm8S2EpU83PYoH</latexit> V1 <latexit sha1_base64="wRi80747asQGAT8xlmPgI3PJnA0=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVSQUVVwU3LvuwD6ilJHGqoWkSkrRQiz8gbtWFKwUR8TPc+AMu+gUiLiu4ceFtGhAt6h1m5syZe+6cmZFNTbUdxjo+YWh4ZHTMPx6YmAxOhcLTM3nbaFgKzymGZlhFWbK5puo856iOxoumxaW6rPGCXNvu7Rea3LJVQ991WiYv16UDXa2qiuQQlcmLlXCUxZkbkUEgeiAKL1JG+BZ72IcBBQ3UwaHDIaxBgk2tBBEMJnFltImzCKnuPscxAqRtUBanDInYGo0HtCp5rE7rXk3bVSt0ikbdImUEMfbE7liXPbJ79sI+fq3Vdmv0vLRolvtablZCJwvZ939VdZodHH6p/vTsoIpN16tK3k2X6d1C6eubRxfd7FYm1l5h1+yV/F+xDnugG+jNN+UmzTOXCNAHiD+fexDkE3FxPb6WTkSTCe8r/FjEMlbpvTeQxA5SyNG5VZziDOe+ZyEozAnz/VTB52lm8S2EpU83PYoH</latexit> V1 <latexit sha1_base64="OqPqwiQtHKyWJfI+h+yTigHYNro=">AAACa3ichVHLSsNAFD2Nr1ofrboRdVEsFTeWaQUVVxVBu5JW7QO0lCSOOjRNQpIWavEHXLpxoRsFEfEz3PgDLvoJIq4quHHhbRoQFfWGyZw5c8+dM3cUUxO2w1jTJ3V19/T2+fsDA4NDw8HQyGjONqqWyrOqoRlWQZFtrgmdZx3haLxgWlyuKBrPK+XV9n6+xi1bGPq2Uzd5sSIf6GJfqLJDVCEl1sTc+spGKRRhMeZG+CeIeyACL9JG6Aa72IMBFVVUwKHDIaxBhk3fDuJgMIkrokGcRUi4+xzHCJC2SlmcMmRiy/Q/oNWOx+q0bte0XbVKp2g0LFKGEWWP7Ja12AO7Y0/s/ddaDbdG20udZqWj5WYpeDK+9favqkKzg8NP1Z+eHexjyfUqyLvpMu1bqB197eistbW8GW3MsCv2TP4vWZPd0w302qt6neGb5wjQA8S/t/snyCVi8YXYfCYRSSa8p/BjEtOYpX4vIokU0si6fT7FOS58L9KYNCFNdVIln6cZw5eQoh/YU4wf</latexit> HiFi-GAN <latexit sha1_base64="y3EJvU+5mZ1gdperGZSuV9a0GDE=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVSQUVVwU3LvuwD6ilJHGqoWkSkrRQiz8gbtWFKwUR8TPc+AMu+gUiLiu4ceFtGhAt6h1m5syZe+6cmZFNTbUdxjo+YWh4ZHTMPx6YmAxOhcLTM3nbaFgKzymGZlhFWbK5puo856iOxoumxaW6rPGCXNvu7Rea3LJVQ991WiYv16UDXa2qiuQQlcknKuEoizM3IoNA9EAUXqSM8C32sA8DChqog0OHQ1iDBJtaCSIYTOLKaBNnEVLdfY5jBEjboCxOGRKxNRoPaFXyWJ3WvZq2q1boFI26RcoIYuyJ3bEue2T37IV9/Fqr7dboeWnRLPe13KyEThay7/+q6jQ7OPxS/enZQRWbrleVvJsu07uF0tc3jy662a1MrL3Crtkr+b9iHfZAN9Cbb8pNmmcuEaAPEH8+9yDIJ+LienwtnYgmE95X+LGIZazSe28giR2kkKNzqzjFGc59z0JQmBPm+6mCz9PM4lsIS585PYoI</latexit> V2 <latexit sha1_base64="y3EJvU+5mZ1gdperGZSuV9a0GDE=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVSQUVVwU3LvuwD6ilJHGqoWkSkrRQiz8gbtWFKwUR8TPc+AMu+gUiLiu4ceFtGhAt6h1m5syZe+6cmZFNTbUdxjo+YWh4ZHTMPx6YmAxOhcLTM3nbaFgKzymGZlhFWbK5puo856iOxoumxaW6rPGCXNvu7Rea3LJVQ991WiYv16UDXa2qiuQQlcknKuEoizM3IoNA9EAUXqSM8C32sA8DChqog0OHQ1iDBJtaCSIYTOLKaBNnEVLdfY5jBEjboCxOGRKxNRoPaFXyWJ3WvZq2q1boFI26RcoIYuyJ3bEue2T37IV9/Fqr7dboeWnRLPe13KyEThay7/+q6jQ7OPxS/enZQRWbrleVvJsu07uF0tc3jy662a1MrL3Crtkr+b9iHfZAN9Cbb8pNmmcuEaAPEH8+9yDIJ+LienwtnYgmE95X+LGIZazSe28giR2kkKNzqzjFGc59z0JQmBPm+6mCz9PM4lsIS585PYoI</latexit> V2 <latexit sha1_base64="UaWCFMb5uDR1JBwXFxEs8VWf1eo=">AAACZnichVFNSwJBGH7cvsxKrYiCLpIYdpHRoKKT0KWjH/kBJrK7jba47i67q2DSHwi65qFTQUT0M7r0Bzr4D4qOBl069LouREn1DjPzzDPv884zM5KhKpbNWM8jjI1PTE55p30zs3P+QHB+IW/pTVPmOVlXdbMoiRZXFY3nbMVWedEwudiQVF6Q6nuD/UKLm5aiawd22+DlhljTlKoiizZR2ai0UQmGWYw5ERoFcReE4UZKD97iEEfQIaOJBjg02IRViLColRAHg0FcGR3iTEKKs89xCh9pm5TFKUMktk5jjVYll9VoPahpOWqZTlGpm6QMIcKe2B3rs0d2z17Yx6+1Ok6NgZc2zdJQy41K4Gwl+/6vqkGzjeMv1Z+ebVSx43hVyLvhMINbyEN966Tbz+5mIp11ds1eyf8V67EHuoHWepNv0jxzCR99QPznc4+CfCIW34ptphPhZML9Ci9WsYYovfc2kthHCjk6t4ZzXKDreRb8wpKwPEwVPK5mEd9CCH0CtPuKPQ==</latexit> (b) <latexit sha1_base64="UaWCFMb5uDR1JBwXFxEs8VWf1eo=">AAACZnichVFNSwJBGH7cvsxKrYiCLpIYdpHRoKKT0KWjH/kBJrK7jba47i67q2DSHwi65qFTQUT0M7r0Bzr4D4qOBl069LouREn1DjPzzDPv884zM5KhKpbNWM8jjI1PTE55p30zs3P+QHB+IW/pTVPmOVlXdbMoiRZXFY3nbMVWedEwudiQVF6Q6nuD/UKLm5aiawd22+DlhljTlKoiizZR2ai0UQmGWYw5ERoFcReE4UZKD97iEEfQIaOJBjg02IRViLColRAHg0FcGR3iTEKKs89xCh9pm5TFKUMktk5jjVYll9VoPahpOWqZTlGpm6QMIcKe2B3rs0d2z17Yx6+1Ok6NgZc2zdJQy41K4Gwl+/6vqkGzjeMv1Z+ebVSx43hVyLvhMINbyEN966Tbz+5mIp11ds1eyf8V67EHuoHWepNv0jxzCR99QPznc4+CfCIW34ptphPhZML9Ci9WsYYovfc2kthHCjk6t4ZzXKDreRb8wpKwPEwVPK5mEd9CCH0CtPuKPQ==</latexit> (b) <latexit sha1_base64="ZOnFrXdjAvOTmaq5mzhoYiHXfh4=">AAACZnichVFNSwJBGH7cvsxKrYiCLpIYdpHRoKKT0KWjH/kBJrK7jba47i67q2DSHwi65qFTQUT0M7r0Bzr4D4qOBl069LouREn1DjPzzDPv884zM5KhKpbNWM8jjI1PTE55p30zs3P+QHB+IW/pTVPmOVlXdbMoiRZXFY3nbMVWedEwudiQVF6Q6nuD/UKLm5aiawd22+DlhljTlKoiizZR2ai8UQmGWYw5ERoFcReE4UZKD97iEEfQIaOJBjg02IRViLColRAHg0FcGR3iTEKKs89xCh9pm5TFKUMktk5jjVYll9VoPahpOWqZTlGpm6QMIcKe2B3rs0d2z17Yx6+1Ok6NgZc2zdJQy41K4Gwl+/6vqkGzjeMv1Z+ebVSx43hVyLvhMINbyEN966Tbz+5mIp11ds1eyf8V67EHuoHWepNv0jxzCR99QPznc4+CfCIW34ptphPhZML9Ci9WsYYovfc2kthHCjk6t4ZzXKDreRb8wpKwPEwVPK5mEd9CCH0CtvyKPg==</latexit> (c) <latexit sha1_base64="Om/0rlD4Jzk1bZN6Eg6GE6gJvjk=">AAACZXichVHLSsNAFD2Nr1qtrQ9EcGGxVFyVaQUVVwU3boQ+7ANqKUmc1tA0CUlaqMUfELfqwpWCiPgZbvwBF/0CEZcV3LjwNg2IFvUOM3PmzD13zsxIhqpYNmMdjzA0PDI65h33TUz6pwLB6ZmcpTdMmWdlXdXNgiRaXFU0nrUVW+UFw+RiXVJ5Xqpt9/bzTW5aiq7t2S2Dl+piVVMqiizaRKV3M+VgmEWZE6FBEHNBGG4k9eAt9nEAHTIaqINDg01YhQiLWhExMBjEldAmziSkOPscx/CRtkFZnDJEYms0VmlVdFmN1r2alqOW6RSVuknKECLsid2xLntk9+yFffxaq+3U6Hlp0Sz1tdwoB04WMu//quo02zj8Uv3p2UYFm45XhbwbDtO7hdzXN48uupmtdKS9wq7ZK/m/Yh32QDfQmm/yTYqnL+GjD4j9fO5BkItHY+vRtVQ8nIi7X+HFIpaxSu+9gQR2kESWzq3gFGc49zwLfmFOmO+nCh5XM4tvISx9Amk0iiA=</latexit> MS <latexit sha1_base64="JoAM/i32ncRP5FfZj9h6KEIm4p4=">AAACa3ichVG7SgNBFD1Z3/GRaBpRCzFErMJsBBUrQQtLXzEBFdldZ3VwX+xOFjT4A5Y2FrFREBE/w8YfsPATRKwUbCy8u1kQFfUus3PmzD13ztzRPUsEkrGHlNLS2tbe0dmV7u7p7ctk+wfWA7fmG7xsuJbrV3Ut4JZweFkKafGq53PN1i1e0ffno/1KyP1AuM6aPPD4lq3tOsIUhiaJqi4I06xoId/O5lmRxTH6E6gJyCOJJTd7hU3swIWBGmxwOJCELWgI6NuACgaPuC3UifMJiXif4whp0tYoi1OGRuw+/XdptZGwDq2jmkGsNugUi4ZPylEU2D27Zi/sjt2wR/b+a616XCPyckCz3tRybztzPLj69q/Kplli71P1p2cJEzOxV0HevZiJbmE09eHh6cvq7EqhPs4u2BP5P2cP7JZu4ISvxuUyX2kgTQ+gfm/3T7BeKqpTxcnlUn6ulDxFJ4Yxhgnq9zTmsIgllOM+n6CBs9SzklOGlJFmqpJKNDl8CaXwASvQjMg=</latexit> Di↵Wave <latexit sha1_base64="JoAM/i32ncRP5FfZj9h6KEIm4p4=">AAACa3ichVG7SgNBFD1Z3/GRaBpRCzFErMJsBBUrQQtLXzEBFdldZ3VwX+xOFjT4A5Y2FrFREBE/w8YfsPATRKwUbCy8u1kQFfUus3PmzD13ztzRPUsEkrGHlNLS2tbe0dmV7u7p7ctk+wfWA7fmG7xsuJbrV3Ut4JZweFkKafGq53PN1i1e0ffno/1KyP1AuM6aPPD4lq3tOsIUhiaJqi4I06xoId/O5lmRxTH6E6gJyCOJJTd7hU3swIWBGmxwOJCELWgI6NuACgaPuC3UifMJiXif4whp0tYoi1OGRuw+/XdptZGwDq2jmkGsNugUi4ZPylEU2D27Zi/sjt2wR/b+a616XCPyckCz3tRybztzPLj69q/Kplli71P1p2cJEzOxV0HevZiJbmE09eHh6cvq7EqhPs4u2BP5P2cP7JZu4ISvxuUyX2kgTQ+gfm/3T7BeKqpTxcnlUn6ulDxFJ4Yxhgnq9zTmsIgllOM+n6CBs9SzklOGlJFmqpJKNDl8CaXwASvQjMg=</latexit> Di↵Wave <latexit sha1_base64="ZOnFrXdjAvOTmaq5mzhoYiHXfh4=">AAACZnichVFNSwJBGH7cvsxKrYiCLpIYdpHRoKKT0KWjH/kBJrK7jba47i67q2DSHwi65qFTQUT0M7r0Bzr4D4qOBl069LouREn1DjPzzDPv884zM5KhKpbNWM8jjI1PTE55p30zs3P+QHB+IW/pTVPmOVlXdbMoiRZXFY3nbMVWedEwudiQVF6Q6nuD/UKLm5aiawd22+DlhljTlKoiizZR2ai8UQmGWYw5ERoFcReE4UZKD97iEEfQIaOJBjg02IRViLColRAHg0FcGR3iTEKKs89xCh9pm5TFKUMktk5jjVYll9VoPahpOWqZTlGpm6QMIcKe2B3rs0d2z17Yx6+1Ok6NgZc2zdJQy41K4Gwl+/6vqkGzjeMv1Z+ebVSx43hVyLvhMINbyEN966Tbz+5mIp11ds1eyf8V67EHuoHWepNv0jxzCR99QPznc4+CfCIW34ptphPhZML9Ci9WsYYovfc2kthHCjk6t4ZzXKDreRb8wpKwPEwVPK5mEd9CCH0CtvyKPg==</latexit> (c) <latexit sha1_base64="vBBAM2cexqZ0wSOW2lmJfC7FvnQ=">AAACZ3ichVHLSsNAFD2Nr1ofrQoiuKmWiqtwE0Grq4Ibl75aBRVJ4mhD0yQkaUGLP+DCrYIrBRHxM9z4Ay76CcVlBTcuvEkr4qJ6Q2bOnHvPnTMzumuZfkDUiEk9vX39A/HBxNDwyGgyNTZe9J2qZ4iC4ViOt6trvrBMWxQCM7DErusJraJbYkcvr4b5nZrwfNOxt4NTVxxUtBPbPDYNLQgpW/blw1SGZCJSFCUdAmVpkRgsL+dUJZdWwhRHBp1Yd1IP2McRHBioogIBGwFjCxp8/vaggOAyd4A6cx4jM8oLnCPB2ipXCa7QmC3zeMKrvQ5r8zrs6Udqg3ex+PdYmUaWXumRWvRCT9Skz6696lGP0Mspz3pbK9zD5MXU1se/qgrPAUo/qj89BzhGLvJqsnc3YsJTGG197eyqtbWyma3P0R29sf9batAzn8CuvRv3G2LzBgl+gO9bTncHRVVWFuWFDTWTVztPEcc0ZjHP972EPNawjgLvW8IlrnAda0pJaVKaapdKsY5mAr9CmvkCVwKLBw==</latexit> n.s. <latexit sha1_base64="vBBAM2cexqZ0wSOW2lmJfC7FvnQ=">AAACZ3ichVHLSsNAFD2Nr1ofrQoiuKmWiqtwE0Grq4Ibl75aBRVJ4mhD0yQkaUGLP+DCrYIrBRHxM9z4Ay76CcVlBTcuvEkr4qJ6Q2bOnHvPnTMzumuZfkDUiEk9vX39A/HBxNDwyGgyNTZe9J2qZ4iC4ViOt6trvrBMWxQCM7DErusJraJbYkcvr4b5nZrwfNOxt4NTVxxUtBPbPDYNLQgpW/blw1SGZCJSFCUdAmVpkRgsL+dUJZdWwhRHBp1Yd1IP2McRHBioogIBGwFjCxp8/vaggOAyd4A6cx4jM8oLnCPB2ipXCa7QmC3zeMKrvQ5r8zrs6Udqg3ex+PdYmUaWXumRWvRCT9Skz6696lGP0Mspz3pbK9zD5MXU1se/qgrPAUo/qj89BzhGLvJqsnc3YsJTGG197eyqtbWyma3P0R29sf9batAzn8CuvRv3G2LzBgl+gO9bTncHRVVWFuWFDTWTVztPEcc0ZjHP972EPNawjgLvW8IlrnAda0pJaVKaapdKsY5mAr9CmvkCVwKLBw==</latexit> n.s. <latexit sha1_base64="vBBAM2cexqZ0wSOW2lmJfC7FvnQ=">AAACZ3ichVHLSsNAFD2Nr1ofrQoiuKmWiqtwE0Grq4Ibl75aBRVJ4mhD0yQkaUGLP+DCrYIrBRHxM9z4Ay76CcVlBTcuvEkr4qJ6Q2bOnHvPnTMzumuZfkDUiEk9vX39A/HBxNDwyGgyNTZe9J2qZ4iC4ViOt6trvrBMWxQCM7DErusJraJbYkcvr4b5nZrwfNOxt4NTVxxUtBPbPDYNLQgpW/blw1SGZCJSFCUdAmVpkRgsL+dUJZdWwhRHBp1Yd1IP2McRHBioogIBGwFjCxp8/vaggOAyd4A6cx4jM8oLnCPB2ipXCa7QmC3zeMKrvQ5r8zrs6Udqg3ex+PdYmUaWXumRWvRCT9Skz6696lGP0Mspz3pbK9zD5MXU1se/qgrPAUo/qj89BzhGLvJqsnc3YsJTGG197eyqtbWyma3P0R29sf9batAzn8CuvRv3G2LzBgl+gO9bTncHRVVWFuWFDTWTVztPEcc0ZjHP972EPNawjgLvW8IlrnAda0pJaVKaapdKsY5mAr9CmvkCVwKLBw==</latexit> n.s. <latexit sha1_base64="AK1yDHUNut9jiGEQZcpIOmjZzDs=">AAACZ3ichVHLSsNAFD2N7/poVRDBTbVUXJWbKlpdCW5camuroEWSOLahaRKSaUGLP+DCrYIrBRHxM9z4Ay78BHFZwY0Lb9KKuFBvyMyZc++5c2ZGdy3Tl0TPEaWru6e3r38gOjg0PBKLj44VfafuGaJgOJbj7eiaLyzTFgVpSkvsuJ7QaroltvXqWpDfbgjPNx17Sx65olTTyrZ5aBqaDKg9zZf78SSliUhV1UQA1KVFYrC8nM2o2YQapDiS6MSGE7/FHg7gwEAdNQjYkIwtaPD524UKgstcCU3mPEZmmBc4QZS1da4SXKExW+WxzKvdDmvzOujph2qDd7H491iZQIqe6I5a9Ej39EIfv/Zqhj0CL0c8622tcPdjp5P5939VNZ4lKt+qPz1LHCIbejXZuxsywSmMtr5xfN7Kr+RSzVm6plf2f0XP9MAnsBtvxs2myF0iyg/wdcuJ30Exk1YX0/ObC8nVTOcp+jGFGczxfS9hFevYQIH3reAM57iIvCgxZUKZbJcqkY5mHD9Cmf4EJeGLcA==</latexit> ⇤ <latexit sha1_base64="AK1yDHUNut9jiGEQZcpIOmjZzDs=">AAACZ3ichVHLSsNAFD2N7/poVRDBTbVUXJWbKlpdCW5camuroEWSOLahaRKSaUGLP+DCrYIrBRHxM9z4Ay78BHFZwY0Lb9KKuFBvyMyZc++5c2ZGdy3Tl0TPEaWru6e3r38gOjg0PBKLj44VfafuGaJgOJbj7eiaLyzTFgVpSkvsuJ7QaroltvXqWpDfbgjPNx17Sx65olTTyrZ5aBqaDKg9zZf78SSliUhV1UQA1KVFYrC8nM2o2YQapDiS6MSGE7/FHg7gwEAdNQjYkIwtaPD524UKgstcCU3mPEZmmBc4QZS1da4SXKExW+WxzKvdDmvzOujph2qDd7H491iZQIqe6I5a9Ej39EIfv/Zqhj0CL0c8622tcPdjp5P5939VNZ4lKt+qPz1LHCIbejXZuxsywSmMtr5xfN7Kr+RSzVm6plf2f0XP9MAnsBtvxs2myF0iyg/wdcuJ30Exk1YX0/ObC8nVTOcp+jGFGczxfS9hFevYQIH3reAM57iIvCgxZUKZbJcqkY5mHD9Cmf4EJeGLcA==</latexit> ⇤ <latexit sha1_base64="vBBAM2cexqZ0wSOW2lmJfC7FvnQ=">AAACZ3ichVHLSsNAFD2Nr1ofrQoiuKmWiqtwE0Grq4Ibl75aBRVJ4mhD0yQkaUGLP+DCrYIrBRHxM9z4Ay76CcVlBTcuvEkr4qJ6Q2bOnHvPnTMzumuZfkDUiEk9vX39A/HBxNDwyGgyNTZe9J2qZ4iC4ViOt6trvrBMWxQCM7DErusJraJbYkcvr4b5nZrwfNOxt4NTVxxUtBPbPDYNLQgpW/blw1SGZCJSFCUdAmVpkRgsL+dUJZdWwhRHBp1Yd1IP2McRHBioogIBGwFjCxp8/vaggOAyd4A6cx4jM8oLnCPB2ipXCa7QmC3zeMKrvQ5r8zrs6Udqg3ex+PdYmUaWXumRWvRCT9Skz6696lGP0Mspz3pbK9zD5MXU1se/qgrPAUo/qj89BzhGLvJqsnc3YsJTGG197eyqtbWyma3P0R29sf9batAzn8CuvRv3G2LzBgl+gO9bTncHRVVWFuWFDTWTVztPEcc0ZjHP972EPNawjgLvW8IlrnAda0pJaVKaapdKsY5mAr9CmvkCVwKLBw==</latexit> n.s. <latexit sha1_base64="jtLs3k8iJ+pLVTNiOluwZCnxtNM=">AAACZnichVFNSwJBGH7cvsxKrYiCLpIYdpHRoKKT0KWjH/kBJrK7jba47i67q2DSHwi65qFTQUT0M7r0Bzr4D4qOBl069LouREn1DjPzzDPv884zM5KhKpbNWM8jjI1PTE55p30zs3P+QHB+IW/pTVPmOVlXdbMoiRZXFY3nbMVWedEwudiQVF6Q6nuD/UKLm5aiawd22+DlhljTlKoiizZR2ai4UQmGWYw5ERoFcReE4UZKD97iEEfQIaOJBjg02IRViLColRAHg0FcGR3iTEKKs89xCh9pm5TFKUMktk5jjVYll9VoPahpOWqZTlGpm6QMIcKe2B3rs0d2z17Yx6+1Ok6NgZc2zdJQy41K4Gwl+/6vqkGzjeMv1Z+ebVSx43hVyLvhMINbyEN966Tbz+5mIp11ds1eyf8V67EHuoHWepNv0jxzCR99QPznc4+CfCIW34ptphPhZML9Ci9WsYYovfc2kthHCjk6t4ZzXKDreRb8wpKwPEwVPK5mEd9CCH0CsvqKPA==</latexit> (a) <latexit sha1_base64="jtLs3k8iJ+pLVTNiOluwZCnxtNM=">AAACZnichVFNSwJBGH7cvsxKrYiCLpIYdpHRoKKT0KWjH/kBJrK7jba47i67q2DSHwi65qFTQUT0M7r0Bzr4D4qOBl069LouREn1DjPzzDPv884zM5KhKpbNWM8jjI1PTE55p30zs3P+QHB+IW/pTVPmOVlXdbMoiRZXFY3nbMVWedEwudiQVF6Q6nuD/UKLm5aiawd22+DlhljTlKoiizZR2ai4UQmGWYw5ERoFcReE4UZKD97iEEfQIaOJBjg02IRViLColRAHg0FcGR3iTEKKs89xCh9pm5TFKUMktk5jjVYll9VoPahpOWqZTlGpm6QMIcKe2B3rs0d2z17Yx6+1Ok6NgZc2zdJQy41K4Gwl+/6vqkGzjeMv1Z+ebVSx43hVyLvhMINbyEN966Tbz+5mIp11ds1eyf8V67EHuoHWepNv0jxzCR99QPznc4+CfCIW34ptphPhZML9Ci9WsYYovfc2kthHCjk6t4ZzXKDreRb8wpKwPEwVPK5mEd9CCH0CsvqKPA==</latexit> (a) <latexit sha1_base64="ZOnFrXdjAvOTmaq5mzhoYiHXfh4=">AAACZnichVFNSwJBGH7cvsxKrYiCLpIYdpHRoKKT0KWjH/kBJrK7jba47i67q2DSHwi65qFTQUT0M7r0Bzr4D4qOBl069LouREn1DjPzzDPv884zM5KhKpbNWM8jjI1PTE55p30zs3P+QHB+IW/pTVPmOVlXdbMoiRZXFY3nbMVWedEwudiQVF6Q6nuD/UKLm5aiawd22+DlhljTlKoiizZR2ai8UQmGWYw5ERoFcReE4UZKD97iEEfQIaOJBjg02IRViLColRAHg0FcGR3iTEKKs89xCh9pm5TFKUMktk5jjVYll9VoPahpOWqZTlGpm6QMIcKe2B3rs0d2z17Yx6+1Ok6NgZc2zdJQy41K4Gwl+/6vqkGzjeMv1Z+ebVSx43hVyLvhMINbyEN966Tbz+5mIp11ds1eyf8V67EHuoHWepNv0jxzCR99QPznc4+CfCIW34ptphPhZML9Ci9WsYYovfc2kthHCjk6t4ZzXKDreRb8wpKwPEwVPK5mEd9CCH0CtvyKPg==</latexit> (c) <latexit sha1_base64="jtLs3k8iJ+pLVTNiOluwZCnxtNM=">AAACZnichVFNSwJBGH7cvsxKrYiCLpIYdpHRoKKT0KWjH/kBJrK7jba47i67q2DSHwi65qFTQUT0M7r0Bzr4D4qOBl069LouREn1DjPzzDPv884zM5KhKpbNWM8jjI1PTE55p30zs3P+QHB+IW/pTVPmOVlXdbMoiRZXFY3nbMVWedEwudiQVF6Q6nuD/UKLm5aiawd22+DlhljTlKoiizZR2ai4UQmGWYw5ERoFcReE4UZKD97iEEfQIaOJBjg02IRViLColRAHg0FcGR3iTEKKs89xCh9pm5TFKUMktk5jjVYll9VoPahpOWqZTlGpm6QMIcKe2B3rs0d2z17Yx6+1Ok6NgZc2zdJQy41K4Gwl+/6vqkGzjeMv1Z+ebVSx43hVyLvhMINbyEN966Tbz+5mIp11ds1eyf8V67EHuoHWepNv0jxzCR99QPznc4+CfCIW34ptphPhZML9Ci9WsYYovfc2kthHCjk6t4ZzXKDreRb8wpKwPEwVPK5mEd9CCH0CsvqKPA==</latexit> (a) <latexit sha1_base64="WhPRys5gGrN8wZZSZH4L15PjR+o=">AAACcXichVHLSsNAFD2N7/po1Y3iJrQoglimFVRcKYJ2Ja21KtRakjitg2kSkrSgxR/wBxRctSAifoYbf8CFnyAuK7hx4W0aEC3qHWbmzJl77pyZUS1dOC5jzwGpq7unt69/IDg4NDwSCo+O7TpmxdZ4VjN1095XFYfrwuBZV7g637dsrpRVne+pJ+ut/b0qtx1hGjvuqcXzZaVkiKLQFJeow9ROQp6Tk2JDzG+ubRXCURZjXsidIO6DKPxImeFbHOAIJjRUUAaHAZewDgUOtRziYLCIy6NGnE1IePsc5wiStkJZnDIUYk9oLNEq57MGrVs1HU+t0Sk6dZuUMqbZE7tjTfbI7tkL+/i1Vs2r0fJySrPa1nKrELqYyLz/qyrT7OL4S/WnZxdFLHteBXm3PKZ1C62tr55dNjMr29O1GdZgr+S/zp7ZA93AqL5pN2m+fY0gfUD853N3gt1ELL4YW0gnoqsJ/yv6MYUIZum9l7CKJFLI0rk2rlBHI9CUJiVZirRTpYCvGce3kOY+AUkqjZw=</latexit> PT2 + HiFi-GAN <latexit sha1_base64="2Vpbui2iXTbEJ+Hs6V/+CvwfIWs=">AAACeXichVG7SgNBFD1Z3/EVH4VgEw2RaBHuRlCxUgQRK19RIYawu45xyb7Y3QQ0+AP+gIWNCiLqZ9j4AxZ+glgqWGjhzWZBNKh3mJkzZ+65c2ZGdQzd84keI1JTc0trW3tHtLOru6c31te/6dllVxNZzTZsd1tVPGHolsj6um+IbccViqkaYkstLdT2tyrC9XTb2vAPHJE3laKl7+ma4jNViA2m5sdn44vCVAwRTy3PLxLJ44VYgtIURLwRyCFIIIwVO3aFHezChoYyTAhY8BkbUOBxy0EGwWEujypzLiM92Bc4QpS1Zc4SnKEwW+KxyKtcyFq8rtX0ArXGpxjcXVbGkaQHuqYXuqdbeqKPX2tVgxo1Lwc8q3WtcAq9x0Prb/+qTJ597H+p/vTsYw8zgVedvTsBU7uFVtdXDk9e1mfXktUxuqBn9n9Oj3THN7Aqr9rlqlg7RZQ/QP753I1gM5OWp9KTq5nEXCb8inYMYxQpfu9pzGEJK8jyuYc4wzVuIu/SiJSSJuqpUiTUDOBbSJOflhuPbg==</latexit> (A): Female (JAF001) <latexit sha1_base64="Fpgi/4s939TFOY+QKU+R53Nt9f4=">AAACd3ichVHLSsNAFD2N7/qquhFcWCxK3ZSbCiqufGxEELS1raBSkjitwTQJSVrU4g/4Ay4EQUFU/Aw3/oCLfoK4rCCCC2/TgKiod5iZM2fuuXNmRrUN3fWIaiGppbWtvaOzK9zd09vXHxkYzLpW2dFERrMMy9lUFVcYuikynu4ZYtN2hFJSDZFT95ca+7mKcFzdMje8Q1vslJSiqRd0TfGYykcG44uTc9FVxRDR+MrCKskzk/lIjBLkR/QnkAMQQxBrVuQa29iFBQ1llCBgwmNsQIHLbQsyCDZzO6gy5zDS/X2BY4RZW+YswRkKs/s8Fnm1FbAmrxs1XV+t8SkGd4eVUYzTI91SnR7ojp7o/ddaVb9Gw8shz2pTK+x8/8lw+vVfVYlnD3ufqj89eyhg1veqs3fbZxq30Jr6ytFpPT2XGq9O0CU9s/8LqtE938CsvGhX6yJ1hjB/gPz9uX+CbDIhTyem1pOx+WTwFZ0YwRji/N4zmMcy1pDhcw9wjmvchN6kUWlCijdTpVCgGcKXkOQPxqCOng==</latexit> (B): Male (JAM017) <latexit sha1_base64="vBBAM2cexqZ0wSOW2lmJfC7FvnQ=">AAACZ3ichVHLSsNAFD2Nr1ofrQoiuKmWiqtwE0Grq4Ibl75aBRVJ4mhD0yQkaUGLP+DCrYIrBRHxM9z4Ay76CcVlBTcuvEkr4qJ6Q2bOnHvPnTMzumuZfkDUiEk9vX39A/HBxNDwyGgyNTZe9J2qZ4iC4ViOt6trvrBMWxQCM7DErusJraJbYkcvr4b5nZrwfNOxt4NTVxxUtBPbPDYNLQgpW/blw1SGZCJSFCUdAmVpkRgsL+dUJZdWwhRHBp1Yd1IP2McRHBioogIBGwFjCxp8/vaggOAyd4A6cx4jM8oLnCPB2ipXCa7QmC3zeMKrvQ5r8zrs6Udqg3ex+PdYmUaWXumRWvRCT9Skz6696lGP0Mspz3pbK9zD5MXU1se/qgrPAUo/qj89BzhGLvJqsnc3YsJTGG197eyqtbWyma3P0R29sf9batAzn8CuvRv3G2LzBgl+gO9bTncHRVVWFuWFDTWTVztPEcc0ZjHP972EPNawjgLvW8IlrnAda0pJaVKaapdKsY5mAr9CmvkCVwKLBw==</latexit> n.s. <latexit sha1_base64="vBBAM2cexqZ0wSOW2lmJfC7FvnQ=">AAACZ3ichVHLSsNAFD2Nr1ofrQoiuKmWiqtwE0Grq4Ibl75aBRVJ4mhD0yQkaUGLP+DCrYIrBRHxM9z4Ay76CcVlBTcuvEkr4qJ6Q2bOnHvPnTMzumuZfkDUiEk9vX39A/HBxNDwyGgyNTZe9J2qZ4iC4ViOt6trvrBMWxQCM7DErusJraJbYkcvr4b5nZrwfNOxt4NTVxxUtBPbPDYNLQgpW/blw1SGZCJSFCUdAmVpkRgsL+dUJZdWwhRHBp1Yd1IP2McRHBioogIBGwFjCxp8/vaggOAyd4A6cx4jM8oLnCPB2ipXCa7QmC3zeMKrvQ5r8zrs6Udqg3ex+PdYmUaWXumRWvRCT9Skz6696lGP0Mspz3pbK9zD5MXU1se/qgrPAUo/qj89BzhGLvJqsnc3YsJTGG197eyqtbWyma3P0R29sf9batAzn8CuvRv3G2LzBgl+gO9bTncHRVVWFuWFDTWTVztPEcc0ZjHP972EPNawjgLvW8IlrnAda0pJaVKaapdKsY5mAr9CmvkCVwKLBw==</latexit> n.s. Realizing faster inference while keeping synthesis quality
  14. Multi-stream HiFi-GAN with data-driven waveform decomposition Multi-band HiFi-GAN cannot be

    trained well Introducing trainable synthesis fi lter instead of fi xed synthesis fi lter bank in Multi-band HiFi-GAN Realizing faster inference speed while keeping synthesis quality Demo samples Synthesized speech samples used in experiments are available online 
 https://ast-astrec.nict.go.jp/demo_samples/asru_2021_okamoto/index.html Conclusions Speech demo samples 14
  15. Thank you for your !! Takuma OKAMOTO, NICT, Japan e-mail:

    HP: https://www.okamotocamera.com Twitter: @okamotocamerea 15