Why We Moved Wallaroo From Pony to Rust

https://www.wallaroo.ai/blog-posts/wallaroo-move-t... link-img
avatar

Iz članka:

Wallaroo delivers pushbutton productionization of ML models today, but that wasn’t always the case — before our pivot, our small team of engineers set out to build a next-generation stream processing framework.

The Wallaroo team was clear that building another distributed computing framework in Java was not the answer. We built an initial prototype in Python to test some ideas, and we considered C++, Pony, and Rust. It turns out Pony was a great language for our initial goals around Wallaroo. It helped us solve hard problems quickly without having to build a concurrent runtime from scratch, and it enabled us to meet ambitious performance targets.

However, in the meantime data science and machine learning continued to explode, and we found that customer interest in deploying machine learning models far outstripped demand for more conventional stream processing data algorithms. By the time we started focusing on MLOps, the situation had changed. On one hand, Rust had come a long way in a short period of time. On the other hand, we found that we needed the more robust ecosystem of existing libraries available for Rust.

Our new Rust-based platform recently handled millions of inferences a second of a sophisticated ad-targeting model with a median latency of 5 milliseconds, and a yearly infrastructure cost of $130K. From a customer perspective, that’s a resounding success.

ULOGUJ SE I DODAJ KOMENTAR


Registruj ili prijavi.

VIDI POPULARNE POSTOVE


1
1
avatar Konstantin pre 13 dana
2
1
avatar Lazar pre 44 dana
2
avatar Vukašin pre 44 dana
6
1
avatar Tamara pre 44 dana
4
avatar Stefan pre 99 dana
99
7
avatar Nevenka pre 113 dana
10
2
avatar Ivan pre 131 dana
1
avatar Ivana pre 197 dana
1
avatar Marko pre 208 dana
4
avatar Daniela pre 253 dana