ML Research Wiki / Benchmarks / Spoken Language Understanding / Snips-SmartLights

Snips-SmartLights

Spoken Language Understanding Benchmark

Performance Over Time

📊 Showing 7 results | 📏 Metric: Accuracy (%)

Top Performing Models

Rank Model Paper Accuracy (%) Date Code
1 Finstreder (Conformer, character-based) Finstreder: Simple and fast Spoken Language Understanding with Finite State Transducers using modern Speech-to-Text models 89.00 2022-06-29 📦 Jaco-Assistant/Jaco-Master 📦 Jaco-Assistant/finstreder
2 Finstreder (Conformer) Finstreder: Simple and fast Spoken Language Understanding with Finite State Transducers using modern Speech-to-Text models 88.00 2022-06-29 📦 Jaco-Assistant/Jaco-Master 📦 Jaco-Assistant/finstreder
3 AT-AT Exploring Transfer Learning For End-to-End Spoken Language Understanding 84.90 2020-12-15 -
4 Finstreder (Quartznet) Finstreder: Simple and fast Spoken Language Understanding with Finite State Transducers using modern Speech-to-Text models 84.80 2022-06-29 📦 Jaco-Assistant/Jaco-Master 📦 Jaco-Assistant/finstreder
5 Snips Spoken Language Understanding on the Edge 84.20 2018-10-30 📦 sonos/spoken-language-understanding-research-datasets 📦 CoraJung/flexible-input-slu
6 Google Spoken Language Understanding on the Edge 79.30 2018-10-30 📦 sonos/spoken-language-understanding-research-datasets 📦 CoraJung/flexible-input-slu
7 Real + synthetic Using Speech Synthesis to Train End-to-End Spoken Language Understanding Models 71.40 2019-10-21 📦 dscripka/openwakeword 📦 lorenlugosch/pretrain_speech_model 📦 lorenlugosch/end-to-end-SLU

All Papers (7)

Jaco-Assistant/Jaco-Master Jaco-Assistant/finstreder
Jaco-Assistant/Jaco-Master Jaco-Assistant/finstreder
Jaco-Assistant/Jaco-Master Jaco-Assistant/finstreder
sonos/spoken-language-understanding-research-datasets CoraJung/flexible-input-slu
sonos/spoken-language-understanding-research-datasets CoraJung/flexible-input-slu
dscripka/openwakeword lorenlugosch/pretrain_speech_model lorenlugosch/end-to-end-SLU