I have a rayon::ThreadPool which I want to use to perform CPU bound tasks outside of Tokio's runtime context. The CPU bound tasks are synchronous tasks.
The problem is spawn requires the closure to be 'static but I want to use the borrowed data instead of making owned copies.
Initially I thought scope would work (and the code compiles too), but it seems that it will block until the closure completes - which will defeat my purpose of using this pool i.e. to not block the tokio runtime.
How can I achieve this with rayon or any other threadpool implementation?
pub struct TaskPool {
pool: ThreadPool,
}
impl TaskPool {
pub fn new(num_threads: usize) -> Self {
Self {
pool: ThreadPoolBuilder::new()
.num_threads(num_threads)
.build()
.unwrap(),
}
}
pub async fn verify(&self, hash: &[u8], data: &[u8]) -> bool {
let (tx, rx) = oneshot::channel();
self.pool.spawn(|| {
let ok = hash == calc_sha1(data);
tx.send(ok).unwrap();
});
rx.await.unwrap()
}
}