Inspired and encouraged by several people, including Xiangpeng Hao and Peter Boncz, I define research impact as building practical systems that solve real-world problems, benefit people, and advance the public good.
Here, I collect examples of the impact of my work:
- PystachIO
- Parquet reader in libcudf: I identified a performance issue in the GPU Parquet reader and developed a complete POC to address it. I merged the first half of the POC into libcudf, and the libcudf team carried the remaining work forward. (I am deeply grateful to Muhammad Haseeb and Vukasin Milovanovic for their help!): my libcudf story issue.
- Broader improvements beyond Parquet: The issue I identified was not specific to Parquet, but part of a broader challenge in data-intensive applications. The cuDF team and I called for a rewrite, leading to improvements beyond Parquet: the know-how, the fix in cuDF, the fix in cuCollections.
-
As libcudf is an underlying library, all systems that depend on it can benefit from my work, including cuDF-Spark, Velox-cuDF, Presto-cuDF, Sirius, GQE, and others.
-
(I also need to thank Bradley Dice for the RMM discussions on memory management and for his many motivating words about GPU systems; Tianyu Liu for the KvikIO discussions; and Gregory Kimball, Todd Mostak, Felipe Aramburu, Rodrigo Aramburu, and Joshua Patterson for the general discussions and coordination.)
- Do GPUs Really Need New Tabular File Formats?
-
This work is a call to action not only for the research community, but also for the Parquet and Iceberg communities: my paper incorporated feedback from Andrew Lamb (Parquet PMC), mentioned by Gang Wu (Parquet and Iceberg PMC) in his talk.
-
Although I am not an ASF member, I am active in Parquet Sync and in DataFusion, Arrow, or other Parquet-related community spaces.