blob: 6cf0fc25c7ef7b946604c3a4d1c68eff4c2abf3d (
plain) (
blame)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
|
High-performance inference of OpenAI's Whisper automatic speech recognition
(ASR) model:
Features:
* Plain C/C++ implementation without dependencies
* Apple Silicon first-class citizen - optimized via ARM NEON, Accelerate
framework, Metal and Core ML
* AVX intrinsics support for x86 architectures
* VSX intrinsics support for POWER architectures
* Mixed F16 / F32 precision
* Integer quantization support
* Zero memory allocations at runtime
* Vulkan support
* Support for CPU-only inference
* Efficient GPU support for NVIDIA
* OpenVINO Support
* Ascend NPU Support
* Moore Threads GPU Support
* C-style API
|
