Draft: Allow more spinning threads in threadpool.
This can help reduce latency, at the cost of additional wasted spin cycles.
Coordinating with ARM/Intel to agree on an approach. Both have requested this to reduce latency in certain models.
This can help reduce latency, at the cost of additional wasted spin cycles.
Coordinating with ARM/Intel to agree on an approach. Both have requested this to reduce latency in certain models.