问题原文
原帖链接 · Jacfal · CC BY-SA 4.0
I have parquet file compressed by zstd. It is possible to decompress it somehow? I tried to use zstd command, but without any luck:
[x@xyz tmp]# zstd -d part-00016-303a375a-e443-4f86-a59e-b5d82d15bd26.c000.zstd.parquet -o test.parquet
zstd: part-00016-303a375a-e443-4f86-a59e-b5d82d15bd26.c000.zstd.parquet: unsupported format
已采纳解答
原帖链接 · Jacfal · CC BY-SA 4.0
It is possible via spark-shell on the machine where zstd parquet reading is supported.
spark.read.option("compression", "zstd").parquet("/tmp/parquet-folder").write.option("compression", "none").mode("overwrite").parquet("/tmp/parquet-folder-no-compression")
摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。
