Bing Chat Improves Efficiency & Reduces Latency Issues By 25%

Bing Chat has made some big efficiency improvements and reduced latency issues for some queries by 25%. Mikhail Parakhin, the CEO of Bing, said on Twitter, "yesterday we released a completely reworked backend for inner monologue, reducing time to first token by ~25%, and, far more importantly, making latency more stable, reducing spikes."...