aws-s3-parquet
在找看看如何將 parquet file 寫到 S3 時,意外找到 aws-data-wrangler package,覺得還滿好用的
Reference
- awslabs/aws-data-wrangler: Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
- aws-data-wrangler/tutorials at main · awslabs/aws-data-wrangler 建議這份 tutorial 要整份看過一次
- amazon s3 - How to write parquet file from pandas dataframe in S3 in python - Stack Overflow