Skip to contents

Functions

The conversion functions available in this package

csv_to_parquet()
Convert a csv or a txt file to parquet format
json_to_parquet()
Convert a json file to parquet format
rds_to_parquet()
Convert a rds file to parquet format
fst_to_parquet()
Convert a fst file to parquet format
table_to_parquet()
Convert an input file to parquet format
sqlite_to_parquet()
Convert a sqlite file to parquet format
dbi_to_parquet()
Convert a SQL Query on a DBI connection to parquet format

Other functions

get_parquet_info()
Get various info on parquet files
get_partitions()
get unique values from table's column
check_parquet()
Check if parquet file or dataset is readable and return basic informations
download_extract()
download and uncompress file if needed
rbind_parquet()
Function to bind multiple parquet files by row
parquetize_example()
Get path to parquetize example

Developers

write_parquet_by_chunk()
read input by chunk on function and create dataset
write_parquet_at_once()
write parquet file or dataset based on partition argument