P10.8 Min-Su Shin (Korea Astronomy and Space Science Institute)
Theme: Data processing pipelines
Applications of multiple DBMSs and algorithms for time-domain astronomy
We present results of using multiple database management systems and algorithms in processing and analyzing time-domain astronomy data. Redis is adopted as our main in-memory spatial data storage for processing time-domain alerts. We also use Google's S2 geometry algorithm and its library to generate light curve products in out time-domain observation programs. SQL-compatible DMBSs store source and object catalogs produced in our analysis, and we have tested three systems: RethinkDB, Vitess, and ClickHouse. Our project uses MongoDB as a main database engine for light curves. We share our experiences with these tools in data analysis for time-domain astronomy.
