0343b5ff06
The audio crate will use the denoise crate to remove background noises from microphone input. We intent to contribute this to rodio. Before that can happen a PR needs to land in candle. Until then this lives here. Uses a candle fork which removes the dependency on `protoc` and has the PR's mentioned above already applied. Release Notes: - N/A --------- Co-authored-by: Mikayla <mikayla@zed.dev>
1.1 KiB
1.1 KiB
Real time streaming audio denoising using a Dual-Signal Transformation LSTM Network for Real-Time Noise Suppression.
Trivial to build as it uses the native rust Candle crate for inference. Easy to integrate into any Rodio pipeline.
# use rodio::{nz, source::UniformSourceIterator, wav_to_file};
let file = std::fs::File::open("clips_airconditioning.wav")?;
let decoder = rodio::Decoder::try_from(file)?;
let resampled = UniformSourceIterator::new(decoder, nz!(1), nz!(16_000));
let mut denoised = denoise::Denoiser::try_new(resampled)?;
wav_to_file(&mut denoised, "denoised.wav")?;
Result::Ok<(), Box<dyn std::error::Error>>
Acknowledgements & License
The trained models in this repo are optimized versions of the models in the breizhn/DTLN. These are licensed under MIT.
The FFT code was adapted from Datadog's dtln-rs Repo also licensed under MIT.