|
|
758ab3080b
|
interleve no icon hosts and icons hosts for an even mix
|
2026-05-26 23:50:02 -04:00 |
|
|
|
a799c05f81
|
order by downloaded time to improve ebs read performance
|
2026-05-26 23:10:53 -04:00 |
|
|
|
df2eaa251c
|
shuffle bundle generation using a bucket approach in the assembler
|
2026-05-26 09:11:15 -04:00 |
|
|
|
1343df1a41
|
revert to using host id ordering for bundle generation
|
2026-05-26 01:33:14 -04:00 |
|
|
|
9266c1417d
|
more iops cheese testing - sort by downloaded_at not host id
|
2026-05-26 01:09:32 -04:00 |
|
|
|
a30fe104a3
|
sort by host id to test iops cheese to improve icon read performance
|
2026-05-26 00:43:11 -04:00 |
|
|
|
53205ab661
|
bumped padding of bundles to 6 digits
|
2026-05-25 23:56:13 -04:00 |
|
|
|
33bd0a221e
|
updated s3_key name to icon_hash
|
2026-05-25 21:05:26 -04:00 |
|
|
|
8ceb31bcbb
|
increase bundlegen producer host amount to ensure workers aren't starved
|
2026-05-25 16:21:49 -04:00 |
|
|
|
8dce702e8d
|
upped buffer sizes and switched to 2xlarge to increase speed
|
2026-05-20 12:59:12 -04:00 |
|
|
|
0efec72e45
|
print every 100 bundles
|
2026-05-20 10:17:35 -04:00 |
|
|
|
3bc355e503
|
improved bundle cli output with progress
|
2026-05-20 09:46:59 -04:00 |
|
|
|
081866f62e
|
update bundle gen to use channels and goroutines to saturate disk and not block on db access + bundle coalesing and uploading
|
2026-05-20 01:28:52 -04:00 |
|
|
|
a8177a1583
|
improve stats generation
|
2026-05-20 00:31:38 -04:00 |
|
|
|
eb40995c60
|
just overwrite bundles, don't delete then re-add
|
2026-05-20 00:09:53 -04:00 |
|
|
|
7f36e99443
|
updated random value to double precision float
|
2026-05-19 23:37:50 -04:00 |
|
|
|
e6d5d5175c
|
fixed oom in bundle_gen and added randomOrder, still need a full redesign
|
2026-05-19 10:46:40 -04:00 |
|
|
|
5b3f6a6870
|
switched from s3 to disk for saving icons
|
2026-05-18 12:43:50 -04:00 |
|
|
|
21f2a75ed3
|
delete old tab bundles before making new ones
|
2026-05-18 00:49:50 -04:00 |
|
|
|
f89883e745
|
added bundle generation
|
2026-05-17 23:02:34 -04:00 |
|
