feat: asr & tts & main - #1206

Merged

plutoless merged 181 commits into

mainfrom

feat/asr_guarder

Aug 20, 2025

Commits on Aug 1, 2025

feat: add asr guarder
sunxilin
committed
2be3cd6
chore: refine code
sunxilin
committed
85a6d59
feat: refine azure asr extension
sunxilin
committed
88f24bc
feat: refine azure asr extension
sunxilin
committed
c33387f
feat: add vscode settings
sunxilin
committed
140f3c1
feat: add configs for test
sunxilin
committed
76fb79b
feat: refine azure asr extension
sunxilin
committed
6939a05
feat: refine azure asr extension
sunxilin
committed
f952e37
feat: refine azure asr extension
sunxilin
committed
a70f88a
feat:add azure_asr_python extension connect and reconnect guarder test case (#1133)

committed
6a67109
feat: refine azure asr extension
sunxilin
committed
4e65672
feat: refine asr guarder
sunxilin
committed
c4c254b
feat: refine asr guarder
sunxilin
committed
69cb8ff
feat: refine asr guarder workflow
sunxilin
committed
dbce2f2
fix: requirements
sunxilin
committed
3bb4d00
fix: workflow
sunxilin
committed
945cb19
fix: workflow
sunxilin
committed
984510e
feat: add comprehensive ASR vendor error validation (#1137)

committed
3afb330
fix: workflow
sunxilin
committed
f5f7b58
fix: asr guarder
sunxilin
committed
abc6303
fix: asr guarder
sunxilin
committed
9a869d5
feat: add comprehensive ASR testing suite with multi-language support (#1142)

authored and
sunxilin
committed
15f5b0e
feat: add comprehensive ASR integration test suite (#1148)

authored and
sunxilin
committed
f8c0033
fix: azure asr
sunxilin
committed
a11911f
feat: improve ASR test validation logicFeat/asr guarder (#1152)

committed
13d621e
fix: asr guarder task file
sunxilin
committed
3c76813
refactor: replace silence packet logic with finalize signal in ASR test files (#1155)

committed
08710ba
feat: add tencent_asr_python extension (#1154)

ygcaicn
authored and
sunxilin
committed
07ddb3d
fix: move dump and dump_path from params to config root level in asr_guarder test (#1157)

committed
ce73485
feat: add new deepgram (#1151)

liaochenliang
and
sunxilin
committed
23e659f
fix: asr guarder workflow
sunxilin
committed
c7bacee
fix: asr guarder workflow
sunxilin
committed
a74589f
feat: add new aliyun bigmodel asr (#1166)

liaochenliang
and
sunxilin
committed
89582ed
feat: add new bytedance asr (#1170)

committed
6e4e3fc
feat: update ten_ai_base version and image version
sunxilin
committed
82af945
fix: add words in asr result
sunxilin
committed
d590c9c
Feat/asr guarder (#1179)

authored
4d9bef9
fix: optimize audio timestamp test for multiple ASR providers compatibility (#1181)

authored
90f3231
fix: update ten_ai_base version to 0.6
sunxilin
committed
8ab262e
chore: azure asr version update
sunxilin
committed
7e64fb9
feat: add openai_asr_python extension (#1176)
ygcaicn
authored
e47f6e1
chore: ten_ai_base version
sunxilin
committed
b75d13f

Commits on Aug 5, 2025

fix: tencent asr version
sunxilin
committed
535f06c
[feat]tts2 (#1183)

authored
261a2fe
feat: add Tencent TTS Python extension (#1199)

sunshinexcode
and
plutoless
authored
6f35adc

Commits on Aug 6, 2025

fix: azure asr
sunxilin
committed
a167184
Merge branch 'main' into feat/asr_guarder
plutoless
authored
70f1345
feature: main pipeline (#1134)

plutoless
and
anexpn
authored
0d55505

Commits on Aug 7, 2025

Commits on Aug 8, 2025

feat: add soniox asr extension (#1201)

anexpn
and
sunxilin
authored
c6ece45
feat: add xfyun asr extension (#1202)

liaochenliang
and
sunxilin
authored
17df265
fix: adapt with latest ten_ai_base
sunxilin
committed
07a1fb0
fix: fix metadata
zhangqianze
committed
d4ed0fe
Feat/main plus (#1221)
plutoless
authored
4452f4b

Commits on Aug 9, 2025

feat: place main into default folder
zhangqianze
committed
10d028c
feat: rename main_python & remove module selector/property editor in playground
zhangqianze
committed
ba8e45e
feat: support mllm initial draft
zhangqianze
committed
811aab3

Commits on Aug 10, 2025

feat: support realtime conversation
zhangqianze
committed
4488e60
feat: support realtime api toolcall + fix web ui encoding issue
zhangqianze
committed
01a5d7a

Commits on Aug 11, 2025

fix: remove tmp path
zhangqianze
committed
5af02bf
feat: add lint-extension task
sunxilin
committed
77d8d85
fix: azure asr lint
sunxilin
committed
9e5f498
feat: adjust openai mllm protocols
zhangqianze
committed
dbd7963
test: guarder test for tts and fix bug in bydance_tts_duplex (#1187)

YiminW
and
plutoless
authored
87b0ff8
feat: upgrade ten_ai_base to 0.6 latest
zhangqianze
committed
6d3b777
feat: support grouped names for connections
zhangqianze
committed
508b7af
fix: fix connections
zhangqianze
committed
51d114c
fix: audio dumper in azure asr
sunxilin
committed
8986823
fix: xfyun asr lint (#1237)
liaochenliang
authored
9de2acc
chore: lint code (#1235)
ygcaicn
authored
b8b1f96
feat: add new dify/coze extensions
zhangqianze
committed
9280a2b
feat: add new gemini v2v & stepfun v2v extensions
zhangqianze
committed
d8fee9c
Update ai_agents.yaml
plutoless
authored
0723258
Update ai_agents.yaml
plutoless
authored
9253f8a
feat: fix docker file
zhangqianze
committed
dde4611
fix: refactor azure mllm
zhangqianze
committed
5b4360c

Commits on Aug 12, 2025

Merge branch 'main' into feat/asr_guarder
plutoless
authored
11cc4f4
[feat]tts guarder test (#1240)

authored
14930e4
feat: add aws polly tts extension (#1233)
ygcaicn
authored
7a3a9d0
feat: bytedance_tts_duplex bump version to 0.1.1
wangyoucao577
committed
cd33c05
feat: add JSON ADC credentials for Google ASR and streamline logs; fix Bytedance ASR config lint (#1243)

ZhangPengPaul
and
PaulZhang
authored
0e6f6d5
fix: asr extension lint fix
sunxilin
committed
22c2ab8
Feat/tts refactor-elvenlabs (#1220)
YiminW
authored
79ee54c
feat: add back glm mllm ext
zhangqianze
committed
085df26
feat: remove redundant extensions
zhangqianze
committed
369d9b3
Merge branch 'main' into feat/asr_guarder
plutoless
authored
68ba691
fix: fix manifest.json
zhangqianze
committed
c1cb25c
feat: adjust examples
zhangqianze
committed
17938cd

Commits on Aug 13, 2025

fix: google asr
sunxilin
committed
b10bd7f
fix: format fix
zhangqianze
committed
06863d5
fix: fix lint issues
zhangqianze
committed
d2fc709
fix: fix lint issues
zhangqianze
committed
f8b3014
fix: adjust install script to take out llama deps
zhangqianze
committed
b03359f
fix: aws_asr_python unitest (#1247)

ygcaicn
and
sunxilin
authored
689c8b8
fix: add format for main
zhangqianze
committed
4c20b1e
chore: update version for aws openai and tencent asr
sunxilin
committed
97375f8
fix: replace all base_uri with base_url
zhangqianze
committed
3cf376d
feat: support multiple example local packages
zhangqianze
committed
bc7dc68
feat: adjust demo structure
zhangqianze
committed
a107eb9
fix: fix reasoning mode
zhangqianze
committed
1c79cb7
fix: tts manifest (#1251)

HugoChaan
and
chenyuguo-agora
authored
64cff88
fix: amazon-transcribe version (#1249)
ygcaicn
authored
090ce99
feat: adding demo cases..
zhangqianze
committed
b3f0bca
feat: google tts
YiminW
committed
13d4015
fix: add gemini live
zhangqianze
committed
3cfc12e
Merge branch 'main' into feat/asr_guarder
plutoless
authored
3ddd78e
fix: fix lint issues
zhangqianze
committed
faaaf29
fix: fix gladia tests
zhangqianze
committed
3381922
fix: fix tests
zhangqianze
committed
b9e5c8b

Commits on Aug 14, 2025

feat: add rest demo graphs
zhangqianze
committed
be26764
feat: demo update
zhangqianze
committed
195288b
Merge branch 'main' into feat/asr_guarder
plutoless
authored
e576f89
fix: UT for aliyun gladia speechmatics
sunxilin
committed
aafc81e
fix: format update
zhangqianze
committed
8d9a86d
feat: add cosy TTS Python extension (#1252)

sunshinexcode
and
HugoChaan
authored
8cd7d9d
fix: tts error (#1253)

HugoChaan
and
chenyuguo-agora
authored
80f84d5
fix: 11labs ut use fark key instead of reading environment var
YiminW
committed
e6f99d3
fix: fix google tts issue and update tencent tts version
YiminW
committed
c030799
test: tts guarder test change
YiminW
committed
741b97a
fix: fix google asr test
zhangqianze
committed
4e8a5a8
fix: fix format
zhangqianze
committed
2998a36
fix: fix ut tests
zhangqianze
committed
aef755a
fix: fix google tts ut issue
YiminW
committed
b17d5be
feat: fix format
zhangqianze
committed
1410af8
Merge branch 'main' into feat/asr_guarder
plutoless
authored
06f3f24
fix: remove dependency on pyaudio
zhangqianze
committed
918a065
fix: remove all sounddevice dependencies
zhangqianze
committed
9d8bcfd
fix: fix openai_asr_python tests
zhangqianze
committed
cebf75c
fix: fix tests
zhangqianze
committed
ba37da8
fix: fix format
zhangqianze
committed
008fd73
fix: avoid error racing condition
zhangqianze
committed
1d275b7

Commits on Aug 15, 2025

fix: codeQL warning
sunxilin
committed
882cb94
Merge branch 'main' into feat/asr_guarder
sunxilin
authored
f9fd8e1
fix: codeQL warning
sunxilin
committed
a7bc7aa
fix: fix flush behavior
zhangqianze
committed
a0e1d29
fix: fix format
zhangqianze
committed
f621656
feat: update 11labs tts and google tts version
YiminW
committed
e8af947
fix:tts flush (#1260)

HugoChaan
and
chenyuguo-agora
authored
36cb9b8
feat: speechmatics (#1261)
liaochenliang
authored
cbdf5fb
fix: add package include list for asr exts and upgrade
sunxilin
committed
58dea8a
feat: update package manifest
wangyoucao577
committed
d3f9ee2

Commits on Aug 16, 2025

Commits on Aug 17, 2025

feat: support spanish in speechmatics
sunxilin
committed
cc0236c
feat: update package include for fish_audio openai and cartesia tts
YiminW
committed
8c78576
Fix property for minimax tts

HugoChaan
and
chenyuguo-agora
authored
3ebd83b

Commits on Aug 18, 2025

Merge branch 'main' into feat/asr_guarder
plutoless
authored
c864a1b
fix: fix lint issue
zhangqianze
committed
4e18669
fix: final (#1278)
liaochenliang
authored
c9bcd68
fix: fix main cascade
zhangqianze
committed
14d4818
fix: fix cascade
zhangqianze
committed
09df202
feat: implement tts google bytdance 11labs (#1279)
YiminW
authored
5ec213b
fix: fix integration test err err and unit test err (#1280)
seymourtang
authored
34604bf
fix: add polly_tts property.json (#1282)

ygcaicn
and
plutoless
authored
6bbfec3
fix:self test bugs (#1283)

HugoChaan
and
chenyuguo-agora
authored
2aa49c1
feat: support turn & reasoning
plutoless
committed
c590ecd
fix: handling interrupt
plutoless
committed
c10986f
fix: fix reasoning & adapt
plutoless
committed
5c3a100
fix: fix formats
plutoless
committed
da436a7

Commits on Aug 19, 2025

feat: add ten vad use case
zhangqianze
committed
e3bcecc
fix: bytedance reconnect (#1285)

HugoChaan
and
chenyuguo-agora
authored
63df427
fix: 11labs tts loop maintance websocket connection (#1289)

YiminW
and
wangyimin-agora
authored
d924379
fix: fix bytedance asr finalize (#1288)

ZhangPengPaul
and
PaulZhang
authored
de10fca
fix: xfyun timeout (#1286)

liaochenliang
and
sunxilin
authored
b0dbcdc
fix: ws_client cancel the receiver_task when ws disconnected (#1290)
ygcaicn
authored
945a2d1
chore: update version of openai and tencent asr
sunxilin
committed
5eaf2af
Feat/tts2 improve bytedance (#1291)

authored
b5cdef7
feat: remove legacy tts
plutoless
committed
144e208

Commits on Aug 20, 2025

fix: language (#1293)
liaochenliang
authored
e3a180b
fix: fix wrong dump file naming convention in OpenaiTTSExtension (#1297)
seymourtang
authored
628a82e
fix: fix 11labs tts no audio for short text and change websockt loop (#1296)

YiminW
and
wangyimin-agora
authored
aa0afcb
feat: azure tts python (#1294)
ygcaicn
authored
1764ca1
chore: update version for ten publish
YiminW
committed
e618233
fix: mute_pkg (#1300)

liaochenliang
and
plutoless
authored
46543cb
fix: update default vendors & fix fish audio issue
plutoless
committed
33422ad
Merge branch 'main' into feat/asr_guarder
plutoless
authored
0b051bf