Commit graph

129 commits

Author SHA1 Message Date
81f71bb354 don't show sites that don't allow embeddings 2026-06-02 01:22:20 -04:00
028f30cb77 even simpler about 2026-05-28 09:25:47 -04:00
6a9436ece7 updated about 2026-05-28 09:21:23 -04:00
a60597157d auto open and size about page 2026-05-27 22:17:37 -04:00
bc06e79c6c fix horizontal scroll on mobile 2026-05-27 20:48:06 -04:00
b5787fae94 long url truncate with ... on mobile 2026-05-27 11:36:04 -04:00
0b662019f3 no grey bar beneath the iframe 2026-05-27 11:31:31 -04:00
2fb0e6706f auto open about tab at start 2026-05-27 11:22:26 -04:00
758ab3080b interleve no icon hosts and icons hosts for an even mix 2026-05-26 23:50:02 -04:00
a799c05f81 order by downloaded time to improve ebs read performance 2026-05-26 23:10:53 -04:00
df2eaa251c shuffle bundle generation using a bucket approach in the assembler 2026-05-26 09:11:15 -04:00
4b09a3219a added iotop and iftop for monitoring 2026-05-26 09:10:51 -04:00
79881fce4b add one run.sh for the entire pipeline 2026-05-26 02:09:57 -04:00
767083fb5e increase readahead to improve page cache use 2026-05-26 02:07:38 -04:00
02437a677c updated mobile to show title above 2026-05-26 02:02:21 -04:00
5d80e38249 removed shuffling of hosts to keep hostid for better bundling 2026-05-26 01:42:07 -04:00
1343df1a41 revert to using host id ordering for bundle generation 2026-05-26 01:33:14 -04:00
9266c1417d more iops cheese testing - sort by downloaded_at not host id 2026-05-26 01:09:32 -04:00
a30fe104a3 sort by host id to test iops cheese to improve icon read performance 2026-05-26 00:43:11 -04:00
03f6406e18 added windows styling 2026-05-26 00:04:01 -04:00
54ea6a662c added safari on mac 2026-05-26 00:01:33 -04:00
53205ab661 bumped padding of bundles to 6 digits 2026-05-25 23:56:13 -04:00
59d4d2c9e0 title goes above address bar on mobile 2026-05-25 23:50:58 -04:00
2256055632 faster deploy to clean stale bundles, reading the live site 2026-05-25 23:50:35 -04:00
6649c09d12 longer cache for the tabs/ s3 bucket 2026-05-25 23:33:49 -04:00
8e3907505f deploy frontend from the ec2 at the end of the pipeline 2026-05-25 23:21:50 -04:00
8d62832c1d tmux and htop on the db for performance monitoring 2026-05-25 23:09:40 -04:00
3ea88790b5 frontend now looks like firefox and chrome tabs on linux 2026-05-25 22:53:11 -04:00
7c4572aafb EVEN MORE CONCURRENCYYYY 2026-05-25 22:00:53 -04:00
6c64ffcf94 upped concurrent s3 requests to speed up cc-index download 2026-05-25 21:53:57 -04:00
4bfe165fac update infra README for cloud init 2026-05-25 21:43:31 -04:00
a92c838d23 fix ec2 provisioning for cloud init 2026-05-25 21:43:12 -04:00
7c5573c24d add filter to squash warning 2026-05-25 21:40:01 -04:00
33bd0a221e updated s3_key name to icon_hash 2026-05-25 21:05:26 -04:00
e308718eb2 remove icon s3 bucket, add log retention policy, make logs private explicitly 2026-05-25 20:57:11 -04:00
8c005c4f6c two phase best icon selection with a temporary table 2026-05-25 20:55:29 -04:00
a819dabb57 updated number of async writers to warc_parse to accomidate faster db nvme write speeds 2026-05-25 19:41:25 -04:00
bfb7d8f883 updated gitignore 2026-05-25 19:40:42 -04:00
1afbc41599 automated ec2 setup and build 2026-05-25 18:29:37 -04:00
bf8b932cdc switched from rds to i5 ec2 for nvme disk read/write speeds 2026-05-25 18:17:07 -04:00
c93d1736fe tune unbound to take up less memory for our use case 2026-05-25 17:30:29 -04:00
cb8d23842c better gated firefox specific code 2026-05-25 17:18:28 -04:00
8ceb31bcbb increase bundlegen producer host amount to ensure workers aren't starved 2026-05-25 16:21:49 -04:00
4c7a0f54f7 disable keepalives so connections stop after data transfer complete 2026-05-25 16:20:31 -04:00
ca90b7071e optimize db for bulk insert by turning off indexes and vacuum 2026-05-25 14:16:40 -04:00
eec486880a about everytab tab bolded title 2026-05-21 01:02:08 -04:00
0f0acb642f fixed firefox marquee rollover flicker 2026-05-21 00:56:50 -04:00
fe3d5f7039 speed is fixed, no longer dependent on viewport width 2026-05-21 00:44:00 -04:00
b53fd7844b smoother marquee and fixed icon jitter/stutter in firefox 2026-05-21 00:38:33 -04:00
4fa40c7b47 improved write efficency, though we are still bottlenecking on RDS - will switch to local postgres for future runs 2026-05-20 22:38:23 -04:00