|
|
a799c05f81
|
order by downloaded time to improve ebs read performance
|
2026-05-26 23:10:53 -04:00 |
|
|
|
7c4572aafb
|
EVEN MORE CONCURRENCYYYY
|
2026-05-25 22:00:53 -04:00 |
|
|
|
6c64ffcf94
|
upped concurrent s3 requests to speed up cc-index download
|
2026-05-25 21:53:57 -04:00 |
|
|
|
33bd0a221e
|
updated s3_key name to icon_hash
|
2026-05-25 21:05:26 -04:00 |
|
|
|
8dce702e8d
|
upped buffer sizes and switched to 2xlarge to increase speed
|
2026-05-20 12:59:12 -04:00 |
|
|
|
86cff37533
|
download cc-index to home not tmp (which is tmpfs)
|
2026-05-20 09:35:06 -04:00 |
|
|
|
9308b5e039
|
download cc-index first with aws cli instead of streaming it
|
2026-05-20 08:14:22 -04:00 |
|
|
|
564919c5cc
|
added downloaded_at timestamp to icon table
|
2026-05-20 01:35:13 -04:00 |
|
|
|
7f36e99443
|
updated random value to double precision float
|
2026-05-19 23:37:50 -04:00 |
|
|
|
1d5b7bd374
|
added random_order to host table schema
|
2026-05-19 10:47:05 -04:00 |
|
|
|
db81015e0b
|
added query.sh to read the cc-index from s3 parquet files and dump it into our psql db
|
2026-05-17 19:12:25 -04:00 |
|
|
|
fcf203e1d8
|
added infra setup with terraform
|
2026-05-17 16:07:50 -04:00 |
|
