Joe Lothan 4963866427 updated scanning useragent		2026-05-18 00:26:13 -04:00
..
01_cc_index	added query.sh to read the cc-index from s3 parquet files and dump it into our psql db	2026-05-17 19:12:25 -04:00
02_warc_parse	added warc parser	2026-05-17 20:25:59 -04:00
03_icon_download	updated scanning useragent	2026-05-18 00:26:13 -04:00
04_best_icon	don't allow 1 pixel favicons	2026-05-17 23:01:53 -04:00
05_bundle_gen	added bundle generation	2026-05-17 23:02:34 -04:00