Why We Moved Wallaroo From Pony to Rust

https://www.wallaroo.ai/blog-posts/wallaroo-move-t... link-img
avatar

Iz članka:

Wallaroo delivers pushbutton productionization of ML models today, but that wasn’t always the case — before our pivot, our small team of engineers set out to build a next-generation stream processing framework.

The Wallaroo team was clear that building another distributed computing framework in Java was not the answer. We built an initial prototype in Python to test some ideas, and we considered C++, Pony, and Rust. It turns out Pony was a great language for our initial goals around Wallaroo. It helped us solve hard problems quickly without having to build a concurrent runtime from scratch, and it enabled us to meet ambitious performance targets.

However, in the meantime data science and machine learning continued to explode, and we found that customer interest in deploying machine learning models far outstripped demand for more conventional stream processing data algorithms. By the time we started focusing on MLOps, the situation had changed. On one hand, Rust had come a long way in a short period of time. On the other hand, we found that we needed the more robust ecosystem of existing libraries available for Rust.

Our new Rust-based platform recently handled millions of inferences a second of a sophisticated ad-targeting model with a median latency of 5 milliseconds, and a yearly infrastructure cost of $130K. From a customer perspective, that’s a resounding success.

ULOGUJ SE I DODAJ KOMENTAR


Registruj ili prijavi.

VIDI POPULARNE POSTOVE


99
6
avatar Nevenka pre 19 dana
1
avatar Ivana pre 27 dana
1
avatar Marko pre 38 dana
4
avatar Daniela pre 82 dana
6
12
avatar Nikola pre 84 dana
13
4
avatar Vukašin pre 98 dana
5
avatar Vukašin pre 119 dana
2
avatar Vukašin pre 136 dana
21
avatar Vukašin pre 137 dana
4
avatar Djordje pre 139 dana