|
|
081866f62e
|
update bundle gen to use channels and goroutines to saturate disk and not block on db access + bundle coalesing and uploading
|
2026-05-20 01:28:52 -04:00 |
|
|
|
902928235c
|
updated best icon selection logic
|
2026-05-20 01:15:08 -04:00 |
|
|
|
258c6c5f3a
|
updated ARCHITECTURE.md
|
2026-05-19 23:46:06 -04:00 |
|
|
|
6cf6049698
|
rewrote icon selection in english rather than sql
|
2026-05-17 22:22:32 -04:00 |
|
|
|
5a2e37ae06
|
added icon downloader
|
2026-05-17 22:09:03 -04:00 |
|
|
|
db81015e0b
|
added query.sh to read the cc-index from s3 parquet files and dump it into our psql db
|
2026-05-17 19:12:25 -04:00 |
|
|
|
64ae58494b
|
added timestamps, warc parser library, log files, progress bars, and testing the frontend with real data to the PLAN.md
|
2026-05-17 14:16:56 -04:00 |
|
|
|
a327fb3db3
|
fixed diagram and last tweaks before we plan and code
|
2026-05-17 13:10:37 -04:00 |
|
|
|
01b5de040c
|
updated architecture, downloading all icons, millisecond seeds, mermaid diagram, and partial index
|
2026-05-17 13:03:37 -04:00 |
|
|
|
cf6d819f1f
|
initial ARCHITECTURE.md document
|
2026-05-17 12:19:06 -04:00 |
|