|
|
6c64ffcf94
|
upped concurrent s3 requests to speed up cc-index download
|
2026-05-25 21:53:57 -04:00 |
|
|
|
8dce702e8d
|
upped buffer sizes and switched to 2xlarge to increase speed
|
2026-05-20 12:59:12 -04:00 |
|
|
|
86cff37533
|
download cc-index to home not tmp (which is tmpfs)
|
2026-05-20 09:35:06 -04:00 |
|
|
|
9308b5e039
|
download cc-index first with aws cli instead of streaming it
|
2026-05-20 08:14:22 -04:00 |
|
|
|
db81015e0b
|
added query.sh to read the cc-index from s3 parquet files and dump it into our psql db
|
2026-05-17 19:12:25 -04:00 |
|
