logo
Browse Source

Update performance

Signed-off-by: Jael Gu <mengjia.gu@zilliz.com>
main
Jael Gu 2 years ago
parent
commit
6c5899d982
  1. 35
      performance.md

35
performance.md

@ -23,10 +23,10 @@ end = time.time()
print((end-start) / 100) print((end-start) / 100)
``` ```
## Results
## Performance (Default model)
- Device: MacOS, 2.3 GHz Quad-Core Intel Core i7, 8 CPUs - Device: MacOS, 2.3 GHz Quad-Core Intel Core i7, 8 CPUs
- Input: 10s audio, loop for 100 times
- Input: 10s mono audio, shape (1, ), sr , loop for 100 times
| inference method | mem usage | avg time | | inference method | mem usage | avg time |
| -- | -- | -- | | -- | -- | -- |
@ -35,10 +35,39 @@ print((end-start) / 100)
| onnx | 0.3G | 0.378s | | onnx | 0.3G | 0.378s |
- Device: MacOS, 2.3 GHz Quad-Core Intel Core i7, 8 CPUs - Device: MacOS, 2.3 GHz Quad-Core Intel Core i7, 8 CPUs
- Input: 188s audio, loop for 100 times
- Input: 188s stereo audio, shape (2, 8328408), sr 44100, loop for 100 times
| inference method | mem usage | avg time | | inference method | mem usage | avg time |
| -- | -- | -- | | -- | -- | -- |
| pytorch | 2.6G | 8.162s | | pytorch | 2.6G | 8.162s |
| torchscript | 2.8G | 7.507s | | torchscript | 2.8G | 7.507s |
| onnx | 1.7G | 6.769s | | onnx | 1.7G | 6.769s |
- Device: MacOS, 2.3 GHz Quad-Core Intel Core i7, 8 CPUs
- Input: 600s stereo audio, shape (2, 28800000), sr 48000, loop for 20 times
| inference method | mem usage | avg time |
| -- | -- | -- |
| pytorch | 5G | 22.540s |
| torchscript | 4.9G | 22.514s |
| onnx | 3.4G | 17.874s |
## Performance (Distilled model)
- Device: MacOS, 2.3 GHz Quad-Core Intel Core i7, 8 CPUs
- Input: 188s stereo audio, shape (2, 8328408), sr 44100, loop for 20 times
| inference method | mem usage | avg time |
| -- | -- | -- |
| pytorch | 2.6G | 7.215s |
| torchscript | 2.8G | 7.220s |
| onnx | 1G | 6.410s |
- Device: MacOS, 2.3 GHz Quad-Core Intel Core i7, 8 CPUs
- Input: 600s stereo audio, shape (2, 28800000), sr 48000, loop for 20 times
| inference method | mem usage | avg time |
| -- | -- | -- |
| pytorch | 4.9G | 22.482s |
| torchscript | 5.1G | 21.511s |
| onnx | 3.4G | 17.709s |

Loading…
Cancel
Save