Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Check out Apache arrow[0], it chunks data into independent categories (e.g. date) and then indexes it contents for quick paging. It works well with the tidyverse, but not perfect, which is why I was curious as to how you guys were doing it.

1: https://arrow.apache.org/docs/r/articles/data_wrangling.html



Cool, I created an issue for it and will look into it post holidays

https://github.com/4DModeller/fdmr/issues/298#issue-20549082...




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: