hn-gopher, branch HEAD

Remove DateTime::Duration (was not used)

2018-08-22T09:39:49Z

commit 95a2087f06300967d5ffba090cd02d3770b6f2c8 parent 2c2402581a0c5564baac9e283a258d07b8df17ed Author: Stefan Hagen Date: Wed, 22 Aug 2018 11:39:49 +0200 Remove DateTime::Duration (was not used)

Adding archive script, add more blacklist entries

2018-08-21T21:22:53Z

commit 2c2402581a0c5564baac9e283a258d07b8df17ed parent 16f8766887021cbcf42e01e6e2100f0d4bd7e316 Author: Stefan Hagen Date: Tue, 21 Aug 2018 23:22:53 +0200 Adding archive script, add more blacklist entries

Typo in blacklist entry

2018-08-02T12:35:58Z

commit 16f8766887021cbcf42e01e6e2100f0d4bd7e316 parent 8623a7302f45460a20b8ff52923e419829e4f40b Author: Stefan Hagen Date: Thu, 2 Aug 2018 14:35:58 +0200 Typo in blacklist entry

Extend blacklist

2018-08-01T21:07:58Z

commit 8623a7302f45460a20b8ff52923e419829e4f40b parent 2ffdbea646f3d5028a12be096dc3e881a363a335 Author: Stefan Hagen Date: Wed, 1 Aug 2018 23:07:58 +0200 Extend blacklist

Add blacklist, plausibility check, error handling

2018-07-31T21:58:48Z

commit 2ffdbea646f3d5028a12be096dc3e881a363a335 parent a0d7801aaae62f384ff7cbf5a628dfe12b211341 Author: Stefan Hagen Date: Tue, 31 Jul 2018 23:58:48 +0200 Add blacklist, plausibility check, error handling

Add text variants using readability (ruby variant)

2018-07-31T21:13:12Z

commit a0d7801aaae62f384ff7cbf5a628dfe12b211341 parent 58874a778c1585b20a7dbd4696706ad13f248bee Author: Stefan Hagen Date: Tue, 31 Jul 2018 23:13:12 +0200 Add text variants using readability (ruby variant)

Add code comments, article scraper, pagination

2018-07-31T19:16:17Z

commit 58874a778c1585b20a7dbd4696706ad13f248bee parent 837b822cd29a7435100daf6426e86126dcb02dca Author: Stefan Hagen Date: Tue, 31 Jul 2018 21:16:17 +0200 Add code comments, article scraper, pagination

Add backlink to home

2018-07-30T20:05:26Z

commit 837b822cd29a7435100daf6426e86126dcb02dca parent 5e4345a3d84df25425341020f60ab7385bb8b2a5 Author: Stefan Hagen Date: Mon, 30 Jul 2018 22:05:26 +0200 Add backlink to home

5 sec delay for real now

2018-07-30T19:53:01Z

commit 5e4345a3d84df25425341020f60ab7385bb8b2a5 parent 1ad7d93cbdded0dedaa6247afd0503f010aa5731 Author: Stefan Hagen Date: Mon, 30 Jul 2018 21:53:01 +0200 5 sec delay for real now

If the API is not okay, give it 5 sec to recover.

2018-07-30T19:51:37Z

commit 1ad7d93cbdded0dedaa6247afd0503f010aa5731 parent 372838c14e8e7a59129d14c4cdfd5ed2615df69d Author: Stefan Hagen Date: Mon, 30 Jul 2018 21:51:37 +0200 If the API is not okay, give it 5 sec to recover.

scrape less agressive threads: 50->10

2018-07-30T19:49:50Z

commit 372838c14e8e7a59129d14c4cdfd5ed2615df69d parent 74ea59bf91cf72e4d5e82ebd8bc852b7546c1a0a Author: Stefan Hagen Date: Mon, 30 Jul 2018 21:49:50 +0200 scrape less agressive threads: 50->10

big update

2018-07-30T19:43:49Z

commit 74ea59bf91cf72e4d5e82ebd8bc852b7546c1a0a parent 6533286bc1276e7584436c98fa4f88251da82bf9 Author: Stefan Hagen Date: Mon, 30 Jul 2018 21:43:49 +0200 big update - pretty bars - pretty dates - parallel scraping - proper front page top stories - configurable front page story count - link parser update (still a bit wonky) - story file cache

Add level bar | to the side of comments

2018-07-30T14:08:15Z

commit 6533286bc1276e7584436c98fa4f88251da82bf9 parent d93b0ad18f02983bb67885550fa8258095545a34 Author: Stefan Hagen Date: Mon, 30 Jul 2018 16:08:15 +0200 Add level bar | to the side of comments

Consolidate ugly brute force regex

2018-07-30T13:42:16Z

commit d93b0ad18f02983bb67885550fa8258095545a34 parent 1e75ee197e2cc218e808740151f74f1d3516cc87 Author: Stefan Hagen Date: Mon, 30 Jul 2018 15:42:16 +0200 Consolidate ugly brute force regex

Stop hierarchy from going wild

2018-07-30T09:07:42Z

commit 1e75ee197e2cc218e808740151f74f1d3516cc87 parent 2b7e9e0f8bb755628f7f9e77174c93b95e299da6 Author: Stefan Hagen Date: Mon, 30 Jul 2018 11:07:42 +0200 Stop hierarchy from going wild - handle hierarchy > level 20 - decrease hierarchy in recursion

Handle 0 comments and filter frontpage a bit

2018-07-29T21:44:21Z

commit 2b7e9e0f8bb755628f7f9e77174c93b95e299da6 parent 23a060ffd2c3ed13af0c3c49a8938c4802e3e5da Author: Stefan Hagen Date: Sun, 29 Jul 2018 23:44:21 +0200 Handle 0 comments and filter frontpage a bit

Initial Commit

2018-07-29T20:50:47Z

commit 23a060ffd2c3ed13af0c3c49a8938c4802e3e5da Author: Stefan Hagen Date: Sun, 29 Jul 2018 22:50:47 +0200 Initial Commit