This talk describes the architecture of data analytics platform service of Treasure Data, what we use Ruby/JRuby for and what we don't use Ruby for. We will discuss the many reasons, not only for productivity and performance.

Data analytics platform architecture is very far from well-known web service architecture. There are huge scale queues, workers, schedulers and distributed processing clusters, besides well-known parts like web application servers written in RoR and RDBMSs.

Recorded video

Presentation Material

Speaker

TAGOMORI "moris" Satoshi
TAGOMORI "moris" Satoshi
@tagomoris
OSS developer/maintainer: Fluentd, Norikra, MessagePack-Ruby, and many others. Living in Tokyo, and day job is for Treasure Data.