Schedule

Sutou Kouhei
Sutou Kouhei

He is a free software programmer, the president of ClearCode Inc and Apache Arrow PMC (Project Management Committee) chair. He is a leading specialist of Apache Arrow and Ruby in the world. ClearCode Inc. is hiring an employee who wants to develop Apache Arrow for Ruby.

Fast data processing with Ruby and Apache Arrow

I introduced Ruby and Apache Arrow integration including the "super fast large data interchange and processing" Apache Arrow feature at RubyKaigi Takeout 2021.

This talk introduces how we can use the "super fast large data interchange and processing" Apache Arrow feature in Ruby. Here are some use cases:

  • Fast data retrieval (fast pluck) from DB such as MySQL and PostgreSQL for batch processes in a Ruby on Rails application
  • Fast data interchange with JavaScript for dynamic visualization in a Ruby on Rails application
  • Fast OLAP with in-process DB such as DuckDB and Apache Arrow DataFusion in a Ruby on Rails application or irb session