From 6c5899d9823631db2bee8af18d4116eda8ed8c7e Mon Sep 17 00:00:00 2001 From: Jael Gu Date: Tue, 23 Aug 2022 16:18:50 +0800 Subject: [PATCH] Update performance Signed-off-by: Jael Gu --- performance.md | 35 ++++++++++++++++++++++++++++++++--- 1 file changed, 32 insertions(+), 3 deletions(-) diff --git a/performance.md b/performance.md index adc1d5e..ec070a2 100644 --- a/performance.md +++ b/performance.md @@ -23,10 +23,10 @@ end = time.time() print((end-start) / 100) ``` -## Results +## Performance (Default model) - Device: MacOS, 2.3 GHz Quad-Core Intel Core i7, 8 CPUs -- Input: 10s audio, loop for 100 times +- Input: 10s mono audio, shape (1, ), sr , loop for 100 times | inference method | mem usage | avg time | | -- | -- | -- | @@ -35,10 +35,39 @@ print((end-start) / 100) | onnx | 0.3G | 0.378s | - Device: MacOS, 2.3 GHz Quad-Core Intel Core i7, 8 CPUs -- Input: 188s audio, loop for 100 times +- Input: 188s stereo audio, shape (2, 8328408), sr 44100, loop for 100 times | inference method | mem usage | avg time | | -- | -- | -- | | pytorch | 2.6G | 8.162s | | torchscript | 2.8G | 7.507s | | onnx | 1.7G | 6.769s | + +- Device: MacOS, 2.3 GHz Quad-Core Intel Core i7, 8 CPUs +- Input: 600s stereo audio, shape (2, 28800000), sr 48000, loop for 20 times + +| inference method | mem usage | avg time | +| -- | -- | -- | +| pytorch | 5G | 22.540s | +| torchscript | 4.9G | 22.514s | +| onnx | 3.4G | 17.874s | + +## Performance (Distilled model) + +- Device: MacOS, 2.3 GHz Quad-Core Intel Core i7, 8 CPUs +- Input: 188s stereo audio, shape (2, 8328408), sr 44100, loop for 20 times + +| inference method | mem usage | avg time | +| -- | -- | -- | +| pytorch | 2.6G | 7.215s | +| torchscript | 2.8G | 7.220s | +| onnx | 1G | 6.410s | + +- Device: MacOS, 2.3 GHz Quad-Core Intel Core i7, 8 CPUs +- Input: 600s stereo audio, shape (2, 28800000), sr 48000, loop for 20 times + +| inference method | mem usage | avg time | +| -- | -- | -- | +| pytorch | 4.9G | 22.482s | +| torchscript | 5.1G | 21.511s | +| onnx | 3.4G | 17.709s |