首页下载资源人工智能自动语音翻译 seamless

ZIP自动语音翻译 seamless

weixin_4362008213.65MB需要积分:1

资源文件列表:

seamless_communication-main.zip 大约有489个文件
  1. seamless_communication-main/
  2. seamless_communication-main/.gitignore 1.82KB
  3. seamless_communication-main/.gitmodules 84B
  4. seamless_communication-main/.pre-commit-config.yaml 360B
  5. seamless_communication-main/23-11_SEAMLESS_BlogHero_11.17.jpg 287.93KB
  6. seamless_communication-main/ACCEPTABLE_USE_POLICY 4.84KB
  7. seamless_communication-main/CODE_OF_CONDUCT.md 3.45KB
  8. seamless_communication-main/CONTRIBUTING.md 1.49KB
  9. seamless_communication-main/LICENSE 18.88KB
  10. seamless_communication-main/MIT_LICENSE 1.06KB
  11. seamless_communication-main/README.md 22.85KB
  12. seamless_communication-main/SEAMLESS_LICENSE 9.8KB
  13. seamless_communication-main/Seamless_Tutorial.ipynb 8.47MB
  14. seamless_communication-main/demo/
  15. seamless_communication-main/demo/.gitignore 7B
  16. seamless_communication-main/demo/dino_pretssel/
  17. seamless_communication-main/demo/dino_pretssel/audios/
  18. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/
  19. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/dinopretssel/
  20. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/dinopretssel/clean_spk1_default_00240_pred.wav 211.92KB
  21. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/dinopretssel/clean_spk2_default_00026_pred.wav 180.04KB
  22. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/dinopretssel/noisy_spk1_default_00240_pred.wav 174.42KB
  23. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/dinopretssel/noisy_spk2_default_00026_pred.wav 126.61KB
  24. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/pretssel+denoiser/
  25. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/pretssel+denoiser/clean_spk1_default_00240_pred.wav 211.92KB
  26. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/pretssel+denoiser/clean_spk2_default_00026_pred.wav 180.04KB
  27. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/pretssel+denoiser/noisy_spk1_default_00240_pred.wav 174.42KB
  28. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/pretssel+denoiser/noisy_spk2_default_00026_pred.wav 126.61KB
  29. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/pretssel/
  30. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/pretssel/clean_spk1_default_00240_pred.wav 211.92KB
  31. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/pretssel/clean_spk2_default_00026_pred.wav 180.04KB
  32. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/pretssel/noisy_spk1_default_00240_pred.wav 174.42KB
  33. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/pretssel/noisy_spk2_default_00026_pred.wav 126.61KB
  34. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/ref/
  35. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/ref/clean_spk1_default_00240.wav 119.04KB
  36. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/ref/clean_spk2_default_00026.wav 97.04KB
  37. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/ref/noisy_spk1_default_00240.wav 174KB
  38. seamless_communication-main/demo/dino_pretssel/audios/employee_eng_spa/ref/noisy_spk2_default_00026.wav 105.04KB
  39. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/
  40. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/dinopretssel/
  41. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/dinopretssel/clean_spk3_00032_pred.wav 134.11KB
  42. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/dinopretssel/clean_spk4_00003_pred.wav 170.67KB
  43. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/dinopretssel/noisy_spk3_00032_pred.wav 148.17KB
  44. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/dinopretssel/noisy_spk4_00003_pred.wav 183.79KB
  45. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/pretssel+denoiser/
  46. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/pretssel+denoiser/clean_spk3_00032_pred.wav 134.11KB
  47. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/pretssel+denoiser/clean_spk4_00003_pred.wav 170.67KB
  48. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/pretssel+denoiser/noisy_spk3_00032_pred.wav 148.17KB
  49. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/pretssel+denoiser/noisy_spk4_00003_pred.wav 183.79KB
  50. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/pretssel/
  51. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/pretssel/clean_spk3_00032_pred.wav 134.11KB
  52. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/pretssel/clean_spk4_00003_pred.wav 170.67KB
  53. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/pretssel/noisy_spk3_00032_pred.wav 148.17KB
  54. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/pretssel/noisy_spk4_00003_pred.wav 183.79KB
  55. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/ref/
  56. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/ref/clean_spk3_00032.wav 124.04KB
  57. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/ref/clean_spk4_00003.wav 109.04KB
  58. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/ref/noisy_spk3_00032.wav 177.04KB
  59. seamless_communication-main/demo/dino_pretssel/audios/employee_spa_eng/ref/noisy_spk4_00003.wav 130.04KB
  60. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/
  61. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/clean/
  62. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/clean/dinopretssel/
  63. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/clean/dinopretssel/005_#4.wav 88.17KB
  64. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/clean/dinopretssel/022_#41.wav 42.23KB
  65. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/clean/pretssel+denoiser/
  66. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/clean/pretssel+denoiser/005_#4.wav 88.17KB
  67. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/clean/pretssel+denoiser/022_#41.wav 42.23KB
  68. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/clean/pretssel/
  69. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/clean/pretssel/005_#4.wav 88.17KB
  70. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/clean/pretssel/022_#41.wav 42.23KB
  71. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/clean/ref/
  72. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/clean/ref/005_#4.wav 67.54KB
  73. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/clean/ref/022_#41.wav 41.92KB
  74. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/noisy/
  75. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/noisy/dinopretssel/
  76. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/noisy/dinopretssel/005_#4.wav 72.23KB
  77. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/noisy/dinopretssel/022_#41.wav 50.67KB
  78. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/noisy/pretssel+denoiser/
  79. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/noisy/pretssel+denoiser/005_#4.wav 72.23KB
  80. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/noisy/pretssel+denoiser/022_#41.wav 50.67KB
  81. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/noisy/pretssel/
  82. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/noisy/pretssel/005_#4.wav 72.23KB
  83. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/noisy/pretssel/022_#41.wav 50.67KB
  84. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/noisy/ref/
  85. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/noisy/ref/005_#4.wav 67.54KB
  86. seamless_communication-main/demo/dino_pretssel/audios/mdral_spa_eng/noisy/ref/022_#41.wav 41.92KB
  87. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/
  88. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/clean/
  89. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/clean/dinopretssel/
  90. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/clean/dinopretssel/s07_default_00066.wav 122.86KB
  91. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/clean/dinopretssel/s08_default_00020.wav 134.11KB
  92. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/clean/pretssel+denoiser/
  93. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/clean/pretssel+denoiser/s07_default_00066.wav 122.86KB
  94. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/clean/pretssel+denoiser/s08_default_00020.wav 134.11KB
  95. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/clean/pretssel/
  96. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/clean/pretssel/s07_default_00066.wav 122.86KB
  97. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/clean/pretssel/s08_default_00020.wav 134.11KB
  98. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/clean/ref/
  99. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/clean/ref/s07_default_00066.wav 65.87KB
  100. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/clean/ref/s08_default_00020.wav 79.25KB
  101. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/noisy/
  102. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/noisy/dinopretssel/
  103. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/noisy/dinopretssel/s07_default_00066.wav 91.92KB
  104. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/noisy/dinopretssel/s08_default_00020.wav 103.17KB
  105. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/noisy/pretssel+denoiser/
  106. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/noisy/pretssel+denoiser/s07_default_00066.wav 91.92KB
  107. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/noisy/pretssel+denoiser/s08_default_00020.wav 103.17KB
  108. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/noisy/pretssel/
  109. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/noisy/pretssel/s07_default_00066.wav 91.92KB
  110. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/noisy/pretssel/s08_default_00020.wav 103.17KB
  111. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/noisy/ref/
  112. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/noisy/ref/s07_default_00066.wav 65.87KB
  113. seamless_communication-main/demo/dino_pretssel/audios/mexpresso_eng_spa/noisy/ref/s08_default_00020.wav 79.25KB
  114. seamless_communication-main/demo/dino_pretssel/index.html 52.92KB
  115. seamless_communication-main/demo/dino_pretssel/jquery-3.5.js 87.39KB
  116. seamless_communication-main/demo/dino_pretssel/styles.css 7.14KB
  117. seamless_communication-main/demo/dino_pretssel/wavesurfer.js 194.73KB
  118. seamless_communication-main/demo/expressive/
  119. seamless_communication-main/demo/expressive/app.py 8.87KB
  120. seamless_communication-main/demo/expressive/requirements.txt 78B
  121. seamless_communication-main/demo/expressive/utils.py 2.35KB
  122. seamless_communication-main/demo/m4tv1/
  123. seamless_communication-main/demo/m4tv1/app.py 19.13KB
  124. seamless_communication-main/demo/m4tv1/requirements.txt 112B
  125. seamless_communication-main/demo/m4tv2/
  126. seamless_communication-main/demo/m4tv2/app.py 12KB
  127. seamless_communication-main/demo/m4tv2/lang_list.py 4.47KB
  128. seamless_communication-main/demo/m4tv2/requirements.txt 78B
  129. seamless_communication-main/dev_requirements.txt 53B
  130. seamless_communication-main/docs/
  131. seamless_communication-main/docs/expressive/
  132. seamless_communication-main/docs/expressive/README.md 9.68KB
  133. seamless_communication-main/docs/expressive/seamless_align_expressive_README.md 2.18KB
  134. seamless_communication-main/docs/expressive/seamlessexpressive_arch.jpg 179.33KB
  135. seamless_communication-main/docs/m4t/
  136. seamless_communication-main/docs/m4t/README.md 20.43KB
  137. seamless_communication-main/docs/m4t/en_alignment.png 137.85KB
  138. seamless_communication-main/docs/m4t/on_device_README.md 3.11KB
  139. seamless_communication-main/docs/m4t/ru_alignment.png 119.61KB
  140. seamless_communication-main/docs/m4t/seamless_align_README.md 32.92KB
  141. seamless_communication-main/docs/m4t/seamlessm4t_arch.svg 48.9KB
  142. seamless_communication-main/docs/m4t/unity2_aligner_README.md 3.3KB
  143. seamless_communication-main/docs/streaming/
  144. seamless_communication-main/docs/streaming/README.md 3.36KB
  145. seamless_communication-main/docs/streaming/streaming_arch.png 166.3KB
  146. seamless_communication-main/ggml/
  147. seamless_communication-main/ggml/CMakeLists.txt 6.69KB
  148. seamless_communication-main/ggml/LICENSE 1.05KB
  149. seamless_communication-main/ggml/Makefile 1.34KB
  150. seamless_communication-main/ggml/README.md 2.93KB
  151. seamless_communication-main/ggml/build.zig 4.65KB
  152. seamless_communication-main/ggml/ci/
  153. seamless_communication-main/ggml/ci/run.sh 6.1KB
  154. seamless_communication-main/ggml/cmake/
  155. seamless_communication-main/ggml/cmake/BuildTypes.cmake 1.99KB
  156. seamless_communication-main/ggml/cmake/GitVars.cmake 717B
  157. seamless_communication-main/ggml/ctypes_utils.py 2.61KB
  158. seamless_communication-main/ggml/examples/
  159. seamless_communication-main/ggml/examples/CMakeLists.txt 612B
  160. seamless_communication-main/ggml/examples/common-ggml.cpp 8.47KB
  161. seamless_communication-main/ggml/examples/common-ggml.h 410B
  162. seamless_communication-main/ggml/examples/common.cpp 27.06KB
  163. seamless_communication-main/ggml/examples/common.h 5.17KB
  164. seamless_communication-main/ggml/examples/dr_wav.h 235.7KB
  165. seamless_communication-main/ggml/examples/kaldi-native-fbank/
  166. seamless_communication-main/ggml/examples/kaldi-native-fbank/CMakeLists.txt 182B
  167. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/
  168. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/CMakeLists.txt 2.05KB
  169. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/feature-fbank.cc 3.86KB
  170. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/feature-fbank.h 4.39KB
  171. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/feature-functions.cc 1.54KB
  172. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/feature-functions.h 1.5KB
  173. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/feature-window.cc 7.92KB
  174. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/feature-window.h 6.67KB
  175. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/fftsg.c 78.35KB
  176. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/log.cc 4.38KB
  177. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/log.h 11.02KB
  178. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/mel-computations.cc 9.42KB
  179. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/mel-computations.h 3.89KB
  180. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/online-feature.cc 5.26KB
  181. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/online-feature.h 5.27KB
  182. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/rfft.cc 1.68KB
  183. seamless_communication-main/ggml/examples/kaldi-native-fbank/csrc/rfft.h 1.56KB
  184. seamless_communication-main/ggml/examples/python/
  185. seamless_communication-main/ggml/examples/python/README.md 4.71KB
  186. seamless_communication-main/ggml/examples/python/api.h 411B
  187. seamless_communication-main/ggml/examples/python/example_add_quant.py 853B
  188. seamless_communication-main/ggml/examples/python/example_test_all_quants.py 1.9KB
  189. seamless_communication-main/ggml/examples/python/ggml/
  190. seamless_communication-main/ggml/examples/python/ggml/__init__.py 1.87KB
  191. seamless_communication-main/ggml/examples/python/ggml/__init__.pyi 93.12KB
  192. seamless_communication-main/ggml/examples/python/ggml/cffi.py 50.37KB
  193. seamless_communication-main/ggml/examples/python/ggml/ffi/
  194. seamless_communication-main/ggml/examples/python/ggml/ffi/__init__.pyi 60B
  195. seamless_communication-main/ggml/examples/python/ggml/utils.py 8.75KB
  196. seamless_communication-main/ggml/examples/python/regenerate.py 2.09KB
  197. seamless_communication-main/ggml/examples/python/stubs.py 4.41KB
  198. seamless_communication-main/ggml/examples/python/test_tensor.py 9.28KB
  199. seamless_communication-main/ggml/examples/unity/
  200. seamless_communication-main/ggml/examples/unity/CMakeLists.txt 948B
  201. seamless_communication-main/ggml/examples/unity/fairseq2.cpp 69.8KB
  202. seamless_communication-main/ggml/examples/unity/fairseq2.h 9.78KB
  203. seamless_communication-main/ggml/examples/unity/lib/
  204. seamless_communication-main/ggml/examples/unity/lib/unity_lib.cpp 7.9KB
  205. seamless_communication-main/ggml/examples/unity/lib/unity_lib.h 1.29KB
  206. seamless_communication-main/ggml/examples/unity/model_loader.cpp 7.81KB
  207. seamless_communication-main/ggml/examples/unity/model_loader.h 912B
  208. seamless_communication-main/ggml/examples/unity/unity.cpp 7.81KB
  209. seamless_communication-main/ggml/ggml.pc.in 241B
  210. seamless_communication-main/ggml/ggml.py 15.78KB
  211. seamless_communication-main/ggml/ggml_convert.py 25.16KB
  212. seamless_communication-main/ggml/include/
  213. seamless_communication-main/ggml/include/ggml/
  214. seamless_communication-main/ggml/include/ggml/ggml-alloc.h 3.76KB
  215. seamless_communication-main/ggml/include/ggml/ggml-backend.h 8.4KB
  216. seamless_communication-main/ggml/include/ggml/ggml.h 80.77KB
  217. seamless_communication-main/ggml/mt.py 7.18KB
  218. seamless_communication-main/ggml/requirements.txt 157B
  219. seamless_communication-main/ggml/scripts/
  220. seamless_communication-main/ggml/scripts/sync-llama.sh 929B
  221. seamless_communication-main/ggml/scripts/sync-whisper.sh 1.26KB
  222. seamless_communication-main/ggml/src/
  223. seamless_communication-main/ggml/src/CMakeLists.txt 13.81KB
  224. seamless_communication-main/ggml/src/ggml-alloc.c 27.75KB
  225. seamless_communication-main/ggml/src/ggml-backend-impl.h 4.49KB
  226. seamless_communication-main/ggml/src/ggml-backend.c 48.81KB
  227. seamless_communication-main/ggml/src/ggml-cuda.cu 250.53KB
  228. seamless_communication-main/ggml/src/ggml-cuda.h 1.68KB
  229. seamless_communication-main/ggml/src/ggml-impl.h 7.21KB
  230. seamless_communication-main/ggml/src/ggml-metal.h 3.34KB
  231. seamless_communication-main/ggml/src/ggml-metal.m 60.64KB
  232. seamless_communication-main/ggml/src/ggml-metal.metal 76.46KB
  233. seamless_communication-main/ggml/src/ggml-opencl.cpp 67.24KB
  234. seamless_communication-main/ggml/src/ggml-opencl.h 845B
  235. seamless_communication-main/ggml/src/ggml-quants.c 284.4KB
  236. seamless_communication-main/ggml/src/ggml-quants.h 9.99KB
  237. seamless_communication-main/ggml/src/ggml.c 624.27KB
  238. seamless_communication-main/ggml/test_ggml_integration.py 13.41KB
  239. seamless_communication-main/ggml/test_unity_cpp.py 25.83KB
  240. seamless_communication-main/ggml/tests/
  241. seamless_communication-main/ggml/tests/CMakeLists.txt 12.8KB
  242. seamless_communication-main/ggml/tests/test-blas0.c 6.48KB
  243. seamless_communication-main/ggml/tests/test-conv-transpose.c 5.84KB
  244. seamless_communication-main/ggml/tests/test-customop.c 6.55KB
  245. seamless_communication-main/ggml/tests/test-grad0.cpp 51.62KB
  246. seamless_communication-main/ggml/tests/test-mul-mat0.c 10.53KB
  247. seamless_communication-main/ggml/tests/test-mul-mat1.c 8.79KB
  248. seamless_communication-main/ggml/tests/test-mul-mat2.c 89.62KB
  249. seamless_communication-main/ggml/tests/test-opt.cpp 5.6KB
  250. seamless_communication-main/ggml/tests/test-pool.c 4.33KB
  251. seamless_communication-main/ggml/tests/test-quantize-fns.cpp 5.48KB
  252. seamless_communication-main/ggml/tests/test-quantize-perf.cpp 13.68KB
  253. seamless_communication-main/ggml/tests/test-rel-pos.c 2.96KB
  254. seamless_communication-main/ggml/tests/test-svd0.c 5.02KB
  255. seamless_communication-main/ggml/tests/test-vec0.c 3.32KB
  256. seamless_communication-main/ggml/tests/test-vec1.c 20.69KB
  257. seamless_communication-main/ggml/tests/test-vec2.c 7.14KB
  258. seamless_communication-main/ggml/tests/test-xpos.c 3.02KB
  259. seamless_communication-main/ggml/tests/test0.c 1.21KB
  260. seamless_communication-main/ggml/tests/test0.zig 1.39KB
  261. seamless_communication-main/ggml/tests/test1.c 15.23KB
  262. seamless_communication-main/ggml/tests/test1.zig 17.64KB
  263. seamless_communication-main/ggml/tests/test2.c 5.79KB
  264. seamless_communication-main/ggml/tests/test2.zig 5.69KB
  265. seamless_communication-main/ggml/tests/test3.c 2.78KB
  266. seamless_communication-main/ggml/tests/test3.zig 3.2KB
  267. seamless_communication-main/ggml/third_party_ggml.py 269.14KB
  268. seamless_communication-main/pyproject.toml 982B
  269. seamless_communication-main/seamlessM4T.png 193.88KB
  270. seamless_communication-main/setup.py 1.9KB
  271. seamless_communication-main/src/
  272. seamless_communication-main/src/seamless_communication/
  273. seamless_communication-main/src/seamless_communication/__init__.py 516B
  274. seamless_communication-main/src/seamless_communication/cards/
  275. seamless_communication-main/src/seamless_communication/cards/conformer_shaw.yaml 368B
  276. seamless_communication-main/src/seamless_communication/cards/expresso.yaml 294B
  277. seamless_communication-main/src/seamless_communication/cards/mexpresso_text.yaml 312B
  278. seamless_communication-main/src/seamless_communication/cards/mintox.yaml 819B
  279. seamless_communication-main/src/seamless_communication/cards/mutox.yaml 355B
  280. seamless_communication-main/src/seamless_communication/cards/nano.yaml 872B
  281. seamless_communication-main/src/seamless_communication/cards/nar_t2u_aligner.yaml 809B
  282. seamless_communication-main/src/seamless_communication/cards/seamlessM4T_large.yaml 711B
  283. seamless_communication-main/src/seamless_communication/cards/seamlessM4T_medium.yaml 716B
  284. seamless_communication-main/src/seamless_communication/cards/seamlessM4T_v2_large.yaml 829B
  285. seamless_communication-main/src/seamless_communication/cards/seamless_expressivity.yaml 814B
  286. seamless_communication-main/src/seamless_communication/cards/seamless_streaming_monotonic_decoder.yaml 414B
  287. seamless_communication-main/src/seamless_communication/cards/seamless_streaming_unity.yaml 820B
  288. seamless_communication-main/src/seamless_communication/cards/unity_nllb-100.yaml 1.13KB
  289. seamless_communication-main/src/seamless_communication/cards/unity_nllb-200.yaml 1.97KB
  290. seamless_communication-main/src/seamless_communication/cards/vocoder_36langs.yaml 3.92KB
  291. seamless_communication-main/src/seamless_communication/cards/vocoder_pretssel.yaml 4.62KB
  292. seamless_communication-main/src/seamless_communication/cards/vocoder_pretssel_16khz.yaml 4.62KB
  293. seamless_communication-main/src/seamless_communication/cards/vocoder_v2.yaml 3.22KB
  294. seamless_communication-main/src/seamless_communication/cards/xlsr2_1b_v2.yaml 371B
  295. seamless_communication-main/src/seamless_communication/cli/
  296. seamless_communication-main/src/seamless_communication/cli/__init__.py 201B
  297. seamless_communication-main/src/seamless_communication/cli/eval_utils/
  298. seamless_communication-main/src/seamless_communication/cli/eval_utils/__init__.py 633B
  299. seamless_communication-main/src/seamless_communication/cli/eval_utils/compute_metrics.py 13.86KB
  300. seamless_communication-main/src/seamless_communication/cli/eval_utils/lang_mapping.py 3.11KB
  301. seamless_communication-main/src/seamless_communication/cli/expressivity/
  302. seamless_communication-main/src/seamless_communication/cli/expressivity/__init__.py 201B
  303. seamless_communication-main/src/seamless_communication/cli/expressivity/data/
  304. seamless_communication-main/src/seamless_communication/cli/expressivity/data/__init__.py 201B
  305. seamless_communication-main/src/seamless_communication/cli/expressivity/data/prepare_mexpresso.py 7.78KB
  306. seamless_communication-main/src/seamless_communication/cli/expressivity/evaluate/
  307. seamless_communication-main/src/seamless_communication/cli/expressivity/evaluate/__init__.py
  308. seamless_communication-main/src/seamless_communication/cli/expressivity/evaluate/evaluate.py 10.13KB
  309. seamless_communication-main/src/seamless_communication/cli/expressivity/evaluate/post_process_pauserate.py 1.53KB
  310. seamless_communication-main/src/seamless_communication/cli/expressivity/evaluate/run_asr_bleu.py 884B
  311. seamless_communication-main/src/seamless_communication/cli/expressivity/predict/
  312. seamless_communication-main/src/seamless_communication/cli/expressivity/predict/__init__.py 201B
  313. seamless_communication-main/src/seamless_communication/cli/expressivity/predict/predict.py 5.01KB
  314. seamless_communication-main/src/seamless_communication/cli/expressivity/predict/pretssel_generator.py 3KB
  315. seamless_communication-main/src/seamless_communication/cli/m4t/
  316. seamless_communication-main/src/seamless_communication/cli/m4t/__init__.py
  317. seamless_communication-main/src/seamless_communication/cli/m4t/audio_to_units/
  318. seamless_communication-main/src/seamless_communication/cli/m4t/audio_to_units/README.md 1.06KB
  319. seamless_communication-main/src/seamless_communication/cli/m4t/audio_to_units/__init__.py 202B
  320. seamless_communication-main/src/seamless_communication/cli/m4t/audio_to_units/audio_to_units.py 1.65KB
  321. seamless_communication-main/src/seamless_communication/cli/m4t/evaluate/
  322. seamless_communication-main/src/seamless_communication/cli/m4t/evaluate/README.md 1.03KB
  323. seamless_communication-main/src/seamless_communication/cli/m4t/evaluate/__init__.py 202B
  324. seamless_communication-main/src/seamless_communication/cli/m4t/evaluate/evaluate.py 17.6KB
  325. seamless_communication-main/src/seamless_communication/cli/m4t/finetune/
  326. seamless_communication-main/src/seamless_communication/cli/m4t/finetune/README.md 7.29KB
  327. seamless_communication-main/src/seamless_communication/cli/m4t/finetune/__init__.py 202B
  328. seamless_communication-main/src/seamless_communication/cli/m4t/finetune/dataloader.py 11.09KB
  329. seamless_communication-main/src/seamless_communication/cli/m4t/finetune/dataset.py 7.53KB
  330. seamless_communication-main/src/seamless_communication/cli/m4t/finetune/dist_utils.py 1.89KB
  331. seamless_communication-main/src/seamless_communication/cli/m4t/finetune/finetune.py 6.48KB
  332. seamless_communication-main/src/seamless_communication/cli/m4t/finetune/trainer.py 16.47KB
  333. seamless_communication-main/src/seamless_communication/cli/m4t/predict/
  334. seamless_communication-main/src/seamless_communication/cli/m4t/predict/README.md 3.67KB
  335. seamless_communication-main/src/seamless_communication/cli/m4t/predict/__init__.py 433B
  336. seamless_communication-main/src/seamless_communication/cli/m4t/predict/predict.py 7.59KB
  337. seamless_communication-main/src/seamless_communication/cli/streaming/
  338. seamless_communication-main/src/seamless_communication/cli/streaming/README.md 3.01KB
  339. seamless_communication-main/src/seamless_communication/cli/streaming/__init__.py 201B
  340. seamless_communication-main/src/seamless_communication/cli/streaming/evaluate.py 3.18KB
  341. seamless_communication-main/src/seamless_communication/cli/streaming/scorers/
  342. seamless_communication-main/src/seamless_communication/cli/streaming/scorers/__init__.py 201B
  343. seamless_communication-main/src/seamless_communication/cli/streaming/scorers/seamless_quality_scorer.py 4.76KB
  344. seamless_communication-main/src/seamless_communication/cli/toxicity/
  345. seamless_communication-main/src/seamless_communication/cli/toxicity/etox/
  346. seamless_communication-main/src/seamless_communication/cli/toxicity/etox/README.md 3.88KB
  347. seamless_communication-main/src/seamless_communication/cli/toxicity/etox/asr_etox.py 7.07KB
  348. seamless_communication-main/src/seamless_communication/cli/toxicity/etox/etox.py 1.24KB
  349. seamless_communication-main/src/seamless_communication/cli/toxicity/mutox/
  350. seamless_communication-main/src/seamless_communication/cli/toxicity/mutox/README.md 4.12KB
  351. seamless_communication-main/src/seamless_communication/cli/toxicity/mutox/mutox_example.ipynb 6.13KB
  352. seamless_communication-main/src/seamless_communication/cli/toxicity/mutox/mutox_speech.py 3.72KB
  353. seamless_communication-main/src/seamless_communication/cli/toxicity/mutox/mutox_text.py 2.58KB
  354. seamless_communication-main/src/seamless_communication/cli/toxicity/mutox_group_annotations/
  355. seamless_communication-main/src/seamless_communication/cli/toxicity/mutox_group_annotations/README.md 3.14KB
  356. seamless_communication-main/src/seamless_communication/datasets/
  357. seamless_communication-main/src/seamless_communication/datasets/__init__.py 201B
  358. seamless_communication-main/src/seamless_communication/datasets/datatypes.py 1.22KB
  359. seamless_communication-main/src/seamless_communication/datasets/huggingface.py 8.2KB
  360. seamless_communication-main/src/seamless_communication/denoise/
  361. seamless_communication-main/src/seamless_communication/denoise/__init__.py
  362. seamless_communication-main/src/seamless_communication/denoise/demucs.py 4.03KB
  363. seamless_communication-main/src/seamless_communication/inference/
  364. seamless_communication-main/src/seamless_communication/inference/README.md 3.57KB
  365. seamless_communication-main/src/seamless_communication/inference/__init__.py 828B
  366. seamless_communication-main/src/seamless_communication/inference/generator.py 13.34KB
  367. seamless_communication-main/src/seamless_communication/inference/transcriber.py 13.89KB
  368. seamless_communication-main/src/seamless_communication/inference/translator.py 15.29KB
  369. seamless_communication-main/src/seamless_communication/models/
  370. seamless_communication-main/src/seamless_communication/models/__init__.py 201B
  371. seamless_communication-main/src/seamless_communication/models/aligner/
  372. seamless_communication-main/src/seamless_communication/models/aligner/__init__.py 542B
  373. seamless_communication-main/src/seamless_communication/models/aligner/alignment_extractor.py 6.01KB
  374. seamless_communication-main/src/seamless_communication/models/aligner/builder.py 5.3KB
  375. seamless_communication-main/src/seamless_communication/models/aligner/loader.py 2.85KB
  376. seamless_communication-main/src/seamless_communication/models/aligner/model.py 10.03KB
  377. seamless_communication-main/src/seamless_communication/models/conformer_shaw/
  378. seamless_communication-main/src/seamless_communication/models/conformer_shaw/__init__.py 847B
  379. seamless_communication-main/src/seamless_communication/models/conformer_shaw/builder.py 5.69KB
  380. seamless_communication-main/src/seamless_communication/models/conformer_shaw/loader.py 4.29KB
  381. seamless_communication-main/src/seamless_communication/models/generator/
  382. seamless_communication-main/src/seamless_communication/models/generator/__init__.py 202B
  383. seamless_communication-main/src/seamless_communication/models/generator/builder.py 15.72KB
  384. seamless_communication-main/src/seamless_communication/models/generator/ecapa_tdnn.py 13.62KB
  385. seamless_communication-main/src/seamless_communication/models/generator/ecapa_tdnn_builder.py 2.88KB
  386. seamless_communication-main/src/seamless_communication/models/generator/loader.py 858B
  387. seamless_communication-main/src/seamless_communication/models/generator/streamable.py 15.48KB
  388. seamless_communication-main/src/seamless_communication/models/generator/vocoder.py 19.9KB
  389. seamless_communication-main/src/seamless_communication/models/monotonic_decoder/
  390. seamless_communication-main/src/seamless_communication/models/monotonic_decoder/__init__.py 1.1KB
  391. seamless_communication-main/src/seamless_communication/models/monotonic_decoder/builder.py 7.91KB
  392. seamless_communication-main/src/seamless_communication/models/monotonic_decoder/loader.py 4.15KB
  393. seamless_communication-main/src/seamless_communication/models/monotonic_decoder/model.py 1.99KB
  394. seamless_communication-main/src/seamless_communication/models/monotonic_decoder/monotonic_decoder.py 2.76KB
  395. seamless_communication-main/src/seamless_communication/models/monotonic_decoder/monotonic_decoder_layer.py 5.72KB
  396. seamless_communication-main/src/seamless_communication/models/monotonic_decoder/p_choose.py 4.17KB
  397. seamless_communication-main/src/seamless_communication/models/pretssel/
  398. seamless_communication-main/src/seamless_communication/models/pretssel/__init__.py 636B
  399. seamless_communication-main/src/seamless_communication/models/pretssel/ecapa_tdnn.py 13.68KB
  400. seamless_communication-main/src/seamless_communication/models/pretssel/ecapa_tdnn_builder.py 2.88KB
  401. seamless_communication-main/src/seamless_communication/models/tokenizer.py 3.85KB
  402. seamless_communication-main/src/seamless_communication/models/unit_extractor/
  403. seamless_communication-main/src/seamless_communication/models/unit_extractor/__init__.py 556B
  404. seamless_communication-main/src/seamless_communication/models/unit_extractor/kmeans.py 1.05KB
  405. seamless_communication-main/src/seamless_communication/models/unit_extractor/unit_extractor.py 3.89KB
  406. seamless_communication-main/src/seamless_communication/models/unit_extractor/wav2vec2_layer_output.py 3.36KB
  407. seamless_communication-main/src/seamless_communication/models/unity/
  408. seamless_communication-main/src/seamless_communication/models/unity/__init__.py 3.6KB
  409. seamless_communication-main/src/seamless_communication/models/unity/adaptor_block.py 12.43KB
  410. seamless_communication-main/src/seamless_communication/models/unity/builder.py 20.86KB
  411. seamless_communication-main/src/seamless_communication/models/unity/char_tokenizer.py 3.16KB
  412. seamless_communication-main/src/seamless_communication/models/unity/fft_decoder.py 2.4KB
  413. seamless_communication-main/src/seamless_communication/models/unity/fft_decoder_layer.py 6.33KB
  414. seamless_communication-main/src/seamless_communication/models/unity/film.py 1.71KB
  415. seamless_communication-main/src/seamless_communication/models/unity/length_regulator.py 10.58KB
  416. seamless_communication-main/src/seamless_communication/models/unity/loader.py 26.44KB
  417. seamless_communication-main/src/seamless_communication/models/unity/model.py 15.38KB
  418. seamless_communication-main/src/seamless_communication/models/unity/nar_decoder_frontend.py 11.55KB
  419. seamless_communication-main/src/seamless_communication/models/unity/t2u_builder.py 22.06KB
  420. seamless_communication-main/src/seamless_communication/models/unity/unit_tokenizer.py 7.73KB
  421. seamless_communication-main/src/seamless_communication/models/vocoder/
  422. seamless_communication-main/src/seamless_communication/models/vocoder/__init__.py 759B
  423. seamless_communication-main/src/seamless_communication/models/vocoder/builder.py 3.98KB
  424. seamless_communication-main/src/seamless_communication/models/vocoder/codehifigan.py 3.71KB
  425. seamless_communication-main/src/seamless_communication/models/vocoder/hifigan.py 6.38KB
  426. seamless_communication-main/src/seamless_communication/models/vocoder/loader.py 1.37KB
  427. seamless_communication-main/src/seamless_communication/models/vocoder/vocoder.py 1.82KB
  428. seamless_communication-main/src/seamless_communication/py.typed
  429. seamless_communication-main/src/seamless_communication/segment/
  430. seamless_communication-main/src/seamless_communication/segment/__init__.py
  431. seamless_communication-main/src/seamless_communication/segment/silero_vad.py 9.77KB
  432. seamless_communication-main/src/seamless_communication/store.py 1007B
  433. seamless_communication-main/src/seamless_communication/streaming/
  434. seamless_communication-main/src/seamless_communication/streaming/__init__.py 201B
  435. seamless_communication-main/src/seamless_communication/streaming/agents/
  436. seamless_communication-main/src/seamless_communication/streaming/agents/__init__.py 202B
  437. seamless_communication-main/src/seamless_communication/streaming/agents/common.py 989B
  438. seamless_communication-main/src/seamless_communication/streaming/agents/detokenizer.py 2.71KB
  439. seamless_communication-main/src/seamless_communication/streaming/agents/dual_vocoder_agent.py 4KB
  440. seamless_communication-main/src/seamless_communication/streaming/agents/offline_w2v_bert_encoder.py 3.72KB
  441. seamless_communication-main/src/seamless_communication/streaming/agents/online_feature_extractor.py 4.83KB
  442. seamless_communication-main/src/seamless_communication/streaming/agents/online_text_decoder.py 15.01KB
  443. seamless_communication-main/src/seamless_communication/streaming/agents/online_unit_decoder.py 5.73KB
  444. seamless_communication-main/src/seamless_communication/streaming/agents/online_vocoder.py 2.73KB
  445. seamless_communication-main/src/seamless_communication/streaming/agents/pretssel_vocoder.py 5.55KB
  446. seamless_communication-main/src/seamless_communication/streaming/agents/seamless_s2st.py 2.29KB
  447. seamless_communication-main/src/seamless_communication/streaming/agents/seamless_streaming_s2st.py 1.96KB
  448. seamless_communication-main/src/seamless_communication/streaming/agents/seamless_streaming_s2t.py 1.41KB
  449. seamless_communication-main/src/seamless_communication/streaming/agents/silero_vad.py 12.96KB
  450. seamless_communication-main/src/seamless_communication/streaming/agents/unity_pipeline.py 8.1KB
  451. seamless_communication-main/src/seamless_communication/streaming/dataloaders/
  452. seamless_communication-main/src/seamless_communication/streaming/dataloaders/__init__.py 340B
  453. seamless_communication-main/src/seamless_communication/streaming/dataloaders/s2tt.py 8.31KB
  454. seamless_communication-main/src/seamless_communication/toxicity/
  455. seamless_communication-main/src/seamless_communication/toxicity/__init__.py 450B
  456. seamless_communication-main/src/seamless_communication/toxicity/etox_bad_word_checker.py 5.86KB
  457. seamless_communication-main/src/seamless_communication/toxicity/mintox.py 7.77KB
  458. seamless_communication-main/src/seamless_communication/toxicity/mutox/
  459. seamless_communication-main/src/seamless_communication/toxicity/mutox/builder.py 2.16KB
  460. seamless_communication-main/src/seamless_communication/toxicity/mutox/classifier.py 914B
  461. seamless_communication-main/src/seamless_communication/toxicity/mutox/loader.py 1.17KB
  462. seamless_communication-main/src/seamless_communication/toxicity/mutox/speech_pipeline.py 2.03KB
  463. seamless_communication-main/tests/
  464. seamless_communication-main/tests/__init__.py 264B
  465. seamless_communication-main/tests/common.py 3.27KB
  466. seamless_communication-main/tests/conftest.py 1.5KB
  467. seamless_communication-main/tests/integration/
  468. seamless_communication-main/tests/integration/__init__.py 201B
  469. seamless_communication-main/tests/integration/inference/
  470. seamless_communication-main/tests/integration/inference/__init__.py
  471. seamless_communication-main/tests/integration/inference/test_mintox.py 4.26KB
  472. seamless_communication-main/tests/integration/inference/test_translator.py 3.5KB
  473. seamless_communication-main/tests/integration/models/
  474. seamless_communication-main/tests/integration/models/__init__.py 201B
  475. seamless_communication-main/tests/integration/models/test_conformer_shaw.py 1.17KB
  476. seamless_communication-main/tests/integration/models/test_unity2_aligner.py 2.72KB
  477. seamless_communication-main/tests/unit/
  478. seamless_communication-main/tests/unit/__init__.py 201B
  479. seamless_communication-main/tests/unit/denoise/
  480. seamless_communication-main/tests/unit/denoise/__init__.py
  481. seamless_communication-main/tests/unit/denoise/test_demucs.py 1.55KB
  482. seamless_communication-main/tests/unit/models/
  483. seamless_communication-main/tests/unit/models/__init__.py 201B
  484. seamless_communication-main/tests/unit/models/unity/
  485. seamless_communication-main/tests/unit/models/unity/__init__.py 201B
  486. seamless_communication-main/tests/unit/models/unity/test_unity.py 7.79KB
  487. seamless_communication-main/tests/unit/segment/
  488. seamless_communication-main/tests/unit/segment/__init__.py
  489. seamless_communication-main/tests/unit/segment/test_silero_vad.py 1.9KB

资源介绍:

seamless
![](23-11_SEAMLESS_BlogHero_11.17.jpg) # Seamless Intro Seamless is a family of AI models that enable more natural and authentic communication across languages. SeamlessM4T is a massive multilingual multimodal machine translation model supporting around 100 languages. SeamlessM4T serves as foundation for SeamlessExpressive, a model that preserves elements of prosody and voice style across languages and SeamlessStreaming, a model supporting simultaneous translation and streaming ASR for around 100 languages. SeamlessExpressive and SeamlessStreaming are combined into Seamless, a unified model featuring multilinguality, real-time and expressive translations. ## Links ### Demos | | SeamlessM4T v2 | SeamlessExpressive | SeamlessStreaming | | ---------------------- | ------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------ | -------------------------------------------------------------------------------------- | | Demo | [SeamlessM4T v2 Demo](https://seamless.metademolab.com/m4t?utm_source=github&utm_medium=web&utm_campaign=seamless&utm_content=readme) | [SeamlessExpressive Demo](https://seamless.metademolab.com/expressive?utm_source=github&utm_medium=web&utm_campaign=seamless&utm_content=readme) | | | HuggingFace Space Demo | [🤗 SeamlessM4T v2 Space](https://huggingface.co/spaces/facebook/seamless-m4t-v2-large) | [🤗 SeamlessExpressive Space](https://huggingface.co/spaces/facebook/seamless-expressive) | [🤗 SeamlessStreaming Space](https://huggingface.co/spaces/facebook/seamless-streaming) | ### Papers [Seamless](https://ai.facebook.com/research/publications/seamless-multilingual-expressive-and-streaming-speech-translation/) [EMMA](https://ai.meta.com/research/publications/efficient-monotonic-multihead-attention/) [SONAR](https://ai.meta.com/research/publications/sonar-expressive-zero-shot-expressive-speech-to-speech-translation/) ### Blog [AI at Meta Blog](https://ai.meta.com/research/seamless-communication/) ## Tutorial An exhaustive [tutorial](Seamless_Tutorial.ipynb) given at the NeurIPS 2023 - Seamless EXPO, which is a one-stop shop to learn how to use the entire suite of Seamless models. Please feel free to play with the notebook. ## SeamlessM4T SeamlessM4T is our foundational all-in-one **M**assively **M**ultilingual and **M**ultimodal **M**achine **T**ranslation model delivering high-quality translation for speech and text in nearly 100 languages. SeamlessM4T models support the tasks of: - Speech-to-speech translation (S2ST) - Speech-to-text translation (S2TT) - Text-to-speech translation (T2ST) - Text-to-text translation (T2TT) - Automatic speech recognition (ASR) :star2: We are releasing SeamlessM4T v2, an updated version with our novel *UnitY2* architecture. This new model improves over SeamlessM4T v1 in quality as well as inference latency in speech generation tasks. To learn more about the collection of SeamlessM4T models, the approach used in each, their language coverage and their performance, visit the [SeamlessM4T README](docs/m4t/README.md) or [🤗 Model Card](https://huggingface.co/facebook/seamless-m4t-v2-large). > [!NOTE] > Seamless M4T is also available in the 🤗 Transformers library. Visit [this section](docs/m4t/README.md#transformers-usage) for more details. ## SeamlessExpressive SeamlessExpressive is a speech-to-speech translation model that captures certain underexplored aspects of prosody such as speech rate and pauses, while preserving the style of one's voice and high content translation quality. To learn more about SeamlessExpressive models, visit the [SeamlessExpressive README](docs/expressive/README.md) or [🤗 Model Card](https://huggingface.co/facebook/seamless-expressive) ## SeamlessStreaming SeamlessStreaming is a streaming translation model. The model supports speech as input modality and speech/text as output modalities. The SeamlessStreaming model supports the following tasks: - Speech-to-speech translation (S2ST) - Speech-to-text translation (S2TT) - Automatic speech recognition (ASR) To learn more about SeamlessStreaming models, visit the [SeamlessStreaming README](docs/streaming/README.md) or [🤗 Model Card](https://huggingface.co/facebook/seamless-streaming) ## Seamless The Seamless model is the unified model for expressive streaming speech-to-speech translations. ## What's new - [12/18/2023] We are open-sourcing our Conformer-based [W2v-BERT 2.0 speech encoder](#w2v-bert-20-speech-encoder) as described in Section 3.2.1 of the [paper](https://arxiv.org/pdf/2312.05187.pdf), which is at the core of our Seamless models. - [12/14/2023] We are releasing the Seamless [tutorial](#tutorial) given at NeurIPS 2023. # Quick Start ## Installation > [!NOTE] > One of the prerequisites is [fairseq2](https://github.com/facebookresearch/fairseq2) which has pre-built packages available only > for Linux x86-64 and Apple-silicon Mac computers. In addition it has a dependency on [libsndfile](https://github.com/libsndfile/libsndfile) which > might not be installed on your machine. If you experience any installation issues, please refer to its > [README](https://github.com/facebookresearch/fairseq2) for further instructions. ``` pip install . ``` > [!NOTE] > Transcribing inference audio for computing metric uses [Whisper](https://github.com/openai/whisper#setup), which is automatically installed. Whisper in turn requires the command-line tool [`ffmpeg`](https://ffmpeg.org/) to be installed on your system, which is available from most package managers. ## Running inference ### SeamlessM4T Inference Here’s an example of using the CLI from the root directory to run inference. S2ST task: ```bash m4t_predict --task s2st --tgt_lang --output_path ``` T2TT task: ```bash m4t_predict --task t2tt --tgt_lang --src_lang ``` Please refer to the [inference README](src/seamless_communication/cli/m4t/predict) for detailed instruction on how to run inference and the list of supported languages on the source, target sides for speech, text modalities. For running S2TT/ASR natively (without Python) using GGML, please refer to [the unity.cpp section](#unitycpp). ### SeamlessExpressive Inference > [!NOTE] > Please check the [section](#seamlessexpressive-models) on how to download the model. Here’s an example of using the CLI from the root directory to run inference. ```bash expressivity_predict --tgt_lang --model_name seamless_expressivity --vocoder_name vocoder_pretssel --output_path ``` ### SeamlessStreaming and Seamless Inference [Streaming Evaluation README](src/seamless_communication/cli/streaming) has detailed instructions for running evaluations for the SeamlessStreaming and Seamless models. The CLI has an `--no-scoring` option that can be used to skip the scoring part and just run inference. Please check the inference [README](src/seamless_communication/inference) for more details. ## Running SeamlessStreaming Demo You can duplicate the [SeamlessStreaming HF space](https://huggingface.co/spaces/facebook/seamless-streaming?duplicate=true) to run the streaming demo. You can also run the demo loca
100+评论
captcha

    相关资源

    1. 大模型微调入门 LLM-quickstart-main

      weixin_43620082#人工智能ZIP5.95MB2月前
      资源摘要:大模型微调入门

    2. deepseek-engineer-main

      weixin_43620082#人工智能ZIP20.03KB2月前
      资源摘要:deepseek-engineer-main

    3. 新能源锂电池 欧姆龙梯形图程序模板 欧姆龙程序 包膜机程序包蓝膜机程序，某新能源乙方大厂kr程序模板，程序标准化 plc程序，触摸屏，电气接线图，易损件bom清单程序密码 库均已解开（可看

      TzVOUFtjIge#考试认证ZIP1016.62KB2月前
      资源摘要:新能源锂电池 欧姆龙梯形图程序模板 欧姆龙程序 包膜机程序包蓝膜机程序，某新能源乙方大厂kr程序模板，程序标准化。plc程序，触摸屏，电气接线图，易损件bom清单程序密码 库均已解开（可看程序源码）自动流程 初始化流程 手自动安全条件 型 配方保存加载程序和触摸屏来自真实产线，配套使用

    4. comsol多孔介质流固耦合案例，孔压、位移时空演化特征

      TzVOUFtjIge#游戏开发ZIP118.49KB2月前
      资源摘要:comsol多孔介质流固耦合案例，孔压、位移时空演化特征。

    5. 双馈风力发电系统的建模与仿真（含模型和实验报告）

      EPRsoNmGpTbg#安全技术ZIP1.77MB2月前
      资源摘要:双馈风力发电系统的建模与仿真（含模型和实验报告）

    6. 基于两轮差速移动机器人的模型预测控制(mpc)轨迹跟踪(simulnk模型加matlab代码，无联合仿真，横纵向跟踪) ，最新1.轮式移动机器人(WMR,wheeled mobile robot)

      EPRsoNmGpTbg#跨平台ZIP214.59KB2月前
      资源摘要:基于两轮差速移动机器人的模型预测控制(mpc)轨迹跟踪(simulnk模型加matlab代码，无联合仿真，横纵向跟踪) ，最新1.轮式移动机器人(WMR,wheeled mobile robot) 基于两轮差速移动机器人的模型预测控制轨迹跟踪，既可以实现车速的跟踪，又可以实现对路径的跟踪； 2.采用simulnk搭建模型主体，matlab代码搭建MPC控制器，无联合仿真 3.设置了5种轨迹，包括三种车速的圆形轨迹，单车速的直线轨迹，单车速的双移线轨迹，仿真效果如图。 4.包含绘制对比分析图片的代码，可一键绘制轨迹对北比图5.为了使控制量输出平稳，MPCc控制器采用控制增量建立 6.代码规范，重点部分有注释 7.，有参考lunwen

    7. 永磁同步电机非线性磁链观测器估计转子位置1、非线性磁链观测器具有支持低速甚至零速启动或运行，稳定性强，收敛性快的特点2、附带参考文献3、送非线性磁链观测器代码

      EPRsoNmGpTbg#前端ZIP621.93KB2月前
      资源摘要:永磁同步电机非线性磁链观测器估计转子位置1、非线性磁链观测器具有支持低速甚至零速启动或运行，稳定性强，收敛性快的特点2、附带参考文献3、送非线性磁链观测器代码

    8. 多智能体协同无人车无人机无人船编队控制路径跟随基于模型预测控制的无人艇分布式编队协同控制MPC matlab控制仿真 代码 simulink控制器路径规划

      EPRsoNmGpTbg#后端ZIP63.17KB2月前
      资源摘要:多智能体协同无人车无人机无人船编队控制路径跟随基于模型预测控制的无人艇分布式编队协同控制MPC matlab控制仿真 代码 simulink控制器路径规划
    站长QQ:九六九五七三七