]>
git.ipfire.org Git - thirdparty/blocklistproject/lists.git/log
Garrett Post [Fri, 19 Dec 2025 18:08:31 +0000 (12:08 -0600)]
Update stats dashboard
Garrett Post [Fri, 19 Dec 2025 17:31:00 +0000 (11:31 -0600)]
Add release automation, stats dashboard, and dead domain cleanup
Features:
- release.yml: Weekly releases with changelogs showing domains added/removed
- dead-domains.yml: Monthly dead domain checks with auto-issue creation
- generate-stats.py: Statistics dashboard (TLD distribution, categories, overlap)
- generate-changelog.py: Diff-based changelog generation
- check-dead-domains.py: Parallel DNS resolution checking
Stats: 1.7M unique domains across 25 lists, 921 unique TLDs
Garrett Post [Fri, 19 Dec 2025 16:41:14 +0000 (10:41 -0600)]
Regenerate all lists with new build system
All output formats now consistent (hosts, domains, adguard, dnsmasq)
Built with Python pipeline: 23 lists, 2.2M domains
Garrett Post [Fri, 19 Dec 2025 16:34:33 +0000 (10:34 -0600)]
Disable verify step until alt-version files are regenerated
The domains (alt-version) format has fewer entries than hosts format
due to pre-existing data inconsistencies. Verify step will be re-enabled
once all output files are regenerated by the new build system.
Garrett Post [Fri, 19 Dec 2025 16:28:31 +0000 (10:28 -0600)]
Fix verify command to match pipeline function signature
verify_output_consistency takes base_dir and returns list of inconsistencies,
not (is_consistent, mismatches) per list.
Garrett Post [Fri, 19 Dec 2025 16:24:55 +0000 (10:24 -0600)]
Add v2.0 changelog section to README
Explains the rewrite in human-friendly terms:
- Why we rebuilt (maintainability, testing, automation)
- What changed for users (nothing - URLs preserved)
- What changed for contributors (better templates, auto-validation)
- Technical overview (151 tests, config-driven, CI/CD)
Garrett Post [Fri, 19 Dec 2025 16:20:58 +0000 (10:20 -0600)]
Fix linting errors and restore workflows
- Fixed ruff linting errors (unused imports, f-strings, variable names)
- Restored build.yml and triage.yml workflows
- All 151 tests passing, lint clean
gap579137 [Fri, 19 Dec 2025 16:12:05 +0000 (10:12 -0600)]
Delete .github/workflows directory
gap579137 [Fri, 19 Dec 2025 16:09:43 +0000 (10:09 -0600)]
Delete .github/workflows/lint.yml
Garrett Post [Fri, 19 Dec 2025 16:06:06 +0000 (10:06 -0600)]
v2.0: Complete Python rewrite with modern CI/CD
BREAKING CHANGES:
- Removed all JavaScript scripts (replaced with Python)
- New structured issue templates (YAML forms)
- Config-driven build system via config/lists.yml
New Features:
- Python CLI: build.py (build, list, stats, verify, single)
- 4 output formats: hosts, domains, adguard, dnsmasq
- 151 unit tests with full coverage
- CI/CD: build.yml (test/build/validate), triage.yml (auto-label)
- TLD validation and critical domain protection
Files Added:
- pyproject.toml, build.py, config/lists.yml
- src/: config, normalize, merge, validate, format, pipeline
- tests/: 6 test modules (151 tests)
- .github/workflows/: build.yml, triage.yml
- .github/ISSUE_TEMPLATE/: add-request.yml, remove-request.yml
Files Removed:
- scripts/*.js (7 files)
- .github/ISSUE_TEMPLATE/*.md (3 files)
GitHub Actions [Sun, 18 May 2025 03:29:53 +0000 (03:29 +0000)]
Automatically updated using GitHub Actions
gap579137 [Sun, 18 May 2025 03:28:46 +0000 (22:28 -0500)]
Merge branch 'master' of https://github.com/blocklistproject/Lists
gap579137 [Sun, 18 May 2025 03:28:45 +0000 (22:28 -0500)]
tag creation mod
GitHub Actions [Sun, 18 May 2025 03:13:10 +0000 (03:13 +0000)]
Automatically updated using GitHub Actions
gap579137 [Sun, 18 May 2025 03:12:07 +0000 (22:12 -0500)]
rework
gap579137 [Sun, 18 May 2025 02:51:49 +0000 (21:51 -0500)]
Merge branch 'master' of https://github.com/blocklistproject/Lists
gap579137 [Sun, 18 May 2025 02:51:48 +0000 (21:51 -0500)]
update tag
GitHub Actions [Sun, 18 May 2025 02:45:31 +0000 (02:45 +0000)]
Automatically updated using GitHub Actions
gap579137 [Sun, 18 May 2025 02:44:24 +0000 (21:44 -0500)]
Merge branch 'master' of https://github.com/blocklistproject/Lists
gap579137 [Sun, 18 May 2025 02:44:22 +0000 (21:44 -0500)]
migrate2
GitHub Actions [Sun, 18 May 2025 02:29:28 +0000 (02:29 +0000)]
Automatically updated using GitHub Actions
gap579137 [Sun, 18 May 2025 02:27:28 +0000 (21:27 -0500)]
Merge branch 'master' of https://github.com/blocklistproject/Lists
gap579137 [Sun, 18 May 2025 02:25:12 +0000 (21:25 -0500)]
migrate
GitHub Actions [Sun, 18 May 2025 02:18:30 +0000 (02:18 +0000)]
Automatically updated using GitHub Actions
gap579137 [Sun, 18 May 2025 02:17:28 +0000 (21:17 -0500)]
migrate
GitHub Actions [Sun, 18 May 2025 02:13:44 +0000 (02:13 +0000)]
Automatically updated using GitHub Actions
gap579137 [Sun, 18 May 2025 02:12:34 +0000 (21:12 -0500)]
automations
GitHub Actions [Sun, 18 May 2025 00:45:45 +0000 (00:45 +0000)]
Automatically updated using GitHub Actions
Charlie Fish [Sun, 18 May 2025 00:44:47 +0000 (18:44 -0600)]
Merge pull request #1318 from jesscodez/jyao/remove-notion
Remove www.notion.com
Jessica Yao [Tue, 5 Nov 2024 19:23:44 +0000 (14:23 -0500)]
remove notion
GitHub Actions [Tue, 5 Nov 2024 03:58:16 +0000 (03:58 +0000)]
Automatically updated using GitHub Actions
gap579137 [Tue, 5 Nov 2024 03:57:22 +0000 (21:57 -0600)]
Merge pull request #1269 from pckilgore/patch-1
fix: smart-tv.txt
gap579137 [Tue, 5 Nov 2024 03:54:49 +0000 (21:54 -0600)]
Update lint.js
GitHub Actions [Tue, 5 Nov 2024 03:49:05 +0000 (03:49 +0000)]
Automatically updated using GitHub Actions
gap579137 [Tue, 5 Nov 2024 03:48:06 +0000 (21:48 -0600)]
Update lint.js
GitHub Actions [Tue, 5 Nov 2024 03:45:39 +0000 (03:45 +0000)]
Automatically updated using GitHub Actions
gap579137 [Tue, 5 Nov 2024 03:44:44 +0000 (21:44 -0600)]
Update remove-duplicates.js
gap579137 [Tue, 5 Nov 2024 03:43:33 +0000 (21:43 -0600)]
Update remove-duplicates.js
gap579137 [Tue, 5 Nov 2024 03:42:09 +0000 (21:42 -0600)]
Update update-number-of-domains.js
gap579137 [Tue, 5 Nov 2024 03:41:10 +0000 (21:41 -0600)]
Update create-everything-list.js
GitHub Actions [Tue, 5 Nov 2024 03:36:34 +0000 (03:36 +0000)]
Automatically updated using GitHub Actions
gap579137 [Tue, 5 Nov 2024 03:35:29 +0000 (21:35 -0600)]
Update generate-adguard.js
GitHub Actions [Tue, 5 Nov 2024 03:34:38 +0000 (03:34 +0000)]
Automatically updated using GitHub Actions
gap579137 [Tue, 5 Nov 2024 03:33:41 +0000 (21:33 -0600)]
Update generate-dnsmasq.js
GitHub Actions [Tue, 5 Nov 2024 03:32:36 +0000 (03:32 +0000)]
Automatically updated using GitHub Actions
gap579137 [Tue, 5 Nov 2024 03:31:38 +0000 (21:31 -0600)]
Update generate-noip.js
GitHub Actions [Fri, 20 Sep 2024 15:08:43 +0000 (15:08 +0000)]
Automatically updated using GitHub Actions
gap579137 [Fri, 20 Sep 2024 15:07:42 +0000 (10:07 -0500)]
Merge pull request #1276 from thomasmerz/remove_unisex_friseure_de
🚸 remove unisex-friseure.de because it's a simple shop for haircuts
gap579137 [Fri, 20 Sep 2024 15:07:25 +0000 (10:07 -0500)]
Update update-number-of-domains.js
gap579137 [Fri, 20 Sep 2024 15:07:07 +0000 (10:07 -0500)]
Update remove-duplicates.js
gap579137 [Fri, 20 Sep 2024 15:06:27 +0000 (10:06 -0500)]
Update lint.js
gap579137 [Fri, 20 Sep 2024 15:05:22 +0000 (10:05 -0500)]
Update generate-noip.js
gap579137 [Fri, 20 Sep 2024 15:05:05 +0000 (10:05 -0500)]
Update generate-dnsmasq.js
gap579137 [Fri, 20 Sep 2024 15:04:44 +0000 (10:04 -0500)]
Update generate-adguard.js
gap579137 [Fri, 20 Sep 2024 15:04:18 +0000 (10:04 -0500)]
Update create-everything-list.js
Thomas Merz [Mon, 16 Sep 2024 13:51:54 +0000 (15:51 +0200)]
🚸 remove unisex-friseure.de because it's a simple shop for haircuts
Patrick Kilgore [Sun, 25 Aug 2024 17:46:12 +0000 (12:46 -0500)]
fix: smart-tv.txt
This looks like a typo of an otherwise valid cloudfront domain.
GitHub Actions [Mon, 19 Aug 2024 03:32:23 +0000 (03:32 +0000)]
Automatically updated using GitHub Actions
gap579137 [Mon, 19 Aug 2024 03:31:27 +0000 (22:31 -0500)]
Update lint.js
GitHub Actions [Mon, 19 Aug 2024 03:31:00 +0000 (03:31 +0000)]
Automatically updated using GitHub Actions
gap579137 [Mon, 19 Aug 2024 03:30:05 +0000 (22:30 -0500)]
Update remove-duplicates.js
GitHub Actions [Mon, 19 Aug 2024 03:27:52 +0000 (03:27 +0000)]
Automatically updated using GitHub Actions
gap579137 [Mon, 19 Aug 2024 03:26:54 +0000 (22:26 -0500)]
Update update-number-of-domains.js
GitHub Actions [Mon, 19 Aug 2024 03:17:40 +0000 (03:17 +0000)]
Automatically updated using GitHub Actions
gap579137 [Mon, 19 Aug 2024 03:16:44 +0000 (22:16 -0500)]
Merge pull request #1193 from sparrc/rm-kinesis
Remove AWS kinesis from ads list
gap579137 [Mon, 19 Aug 2024 03:16:31 +0000 (22:16 -0500)]
Merge pull request #1185 from LukeWhaskavsky/master
Update porn.txt
gap579137 [Mon, 19 Aug 2024 03:16:12 +0000 (22:16 -0500)]
Merge pull request #1179 from realpixelcode/remove-serveo
Remove serveo.net from malware
gap579137 [Mon, 19 Aug 2024 03:15:58 +0000 (22:15 -0500)]
Merge pull request #1177 from SodaWithoutSparkles/links-fix
Replace dead links and update donations
gap579137 [Mon, 19 Aug 2024 03:15:43 +0000 (22:15 -0500)]
Merge pull request #1204 from aww-yiss/removing_invalid_malware
Removing invalid DNS tld entries from malware.txt
GitHub Actions [Mon, 19 Aug 2024 03:14:30 +0000 (03:14 +0000)]
Automatically updated using GitHub Actions
gap579137 [Mon, 19 Aug 2024 03:13:31 +0000 (22:13 -0500)]
Merge pull request #1242 from Fabbro03/master
Removing sister.agenziaentrate.gov.it (Italian cadastre portal)
gap579137 [Mon, 19 Aug 2024 03:13:04 +0000 (22:13 -0500)]
Merge pull request #1244 from Mailaender/patch-1
Add additional Smartclip related HbbTV domains.
gap579137 [Mon, 19 Aug 2024 03:12:37 +0000 (22:12 -0500)]
Merge pull request #1247 from foreign-affairs/master
squarespace.com
gap579137 [Mon, 19 Aug 2024 03:11:33 +0000 (22:11 -0500)]
Merge pull request #1252 from floschliep/master
Remove shrtm.nu from phishing.txt
gap579137 [Mon, 19 Aug 2024 03:10:45 +0000 (22:10 -0500)]
Merge pull request #1253 from thomasmerz/polyfill_io_malware_by_golem_de
🚸 add some domains to malware due to https://www.golem.de/news/grossteil-aus-deutschland-fast-400-000-webhosts-verbreiten-malware-via-polyfill-io-2407-186716.html
gap579137 [Mon, 19 Aug 2024 03:10:10 +0000 (22:10 -0500)]
Merge pull request #1262 from JnBenites/patch-1
Update gambling.txt
gap579137 [Mon, 19 Aug 2024 03:09:45 +0000 (22:09 -0500)]
Merge pull request #1265 from QWIILXEY/master
fix discord invite link
Qwiil [Tue, 13 Aug 2024 23:56:31 +0000 (19:56 -0400)]
fix discord invite link
Juan B [Mon, 5 Aug 2024 03:21:23 +0000 (22:21 -0500)]
Update gambling.txt
GitHub Actions [Mon, 15 Jul 2024 17:47:33 +0000 (17:47 +0000)]
Automatically updated using GitHub Actions
ShadowSyntax [Mon, 15 Jul 2024 17:46:35 +0000 (12:46 -0500)]
Update README.md
Thomas Merz [Fri, 5 Jul 2024 08:36:26 +0000 (10:36 +0200)]
🚸 add some domains to malware due to https://www.golem.de/news/grossteil-aus-deutschland-fast-400-000-webhosts-verbreiten-malware-via-polyfill-io-2407-186716.html
Thomas Merz [Fri, 5 Jul 2024 10:52:46 +0000 (12:52 +0200)]
🚨 fix pipeline:
- Line 1 in fortnite.txt should have a space after #.
- Line 2 in fortnite.txt must start with "#" or "0.0.0.0 ".
Florian Schliep [Mon, 1 Jul 2024 09:15:29 +0000 (11:15 +0200)]
Remove shrtm.nu from phishing.txt
Spirillen [Mon, 17 Jun 2024 01:26:14 +0000 (03:26 +0200)]
squarespace.com
Removed dead porn records from the project as they are no longer active.
Ref https://github.com/mypdns/matrix/issues/569
Ref https://github.com/ShadowWhisperer/BlockLists/issues/156
Matthias Mailänder [Sat, 15 Jun 2024 10:22:59 +0000 (12:22 +0200)]
Add additional Smartclip related HbbTV domains.
Marco Fabbroni [Wed, 12 Jun 2024 13:28:49 +0000 (15:28 +0200)]
Removing sister.agenziaentrate.gov.it (Italian cadastre portal)
Remove the false positive of the Italian cadastre portal domain
aww-yiss [Sun, 31 Mar 2024 23:00:33 +0000 (19:00 -0400)]
scrub malware.txt list for any values that are not valid TLDs
Signed-off-by: aww-yiss <aww-yiss@deimos.lan>
Josh Bradley [Fri, 29 Mar 2024 12:36:38 +0000 (08:36 -0400)]
Removing two invalid DNS entries from malware.txt
Signed-off-by: Josh Bradley <jbradley@deimos.lan>
Cameron Sparr [Mon, 11 Mar 2024 19:40:26 +0000 (12:40 -0700)]
Remove AWS kinesis from ads list
AWS kinesis is a data stream processing platform in the amazon cloud, it
is not an ad server.
Furthermore, it is a regional service and the ads.txt list only included
one region (us-east-1), so it wasn't effectively blocking this service
anyways. In my home, video cameras were trying and failing to reach
kinesis.us-east-1, but then retrying kinesis.us-west-2 and succeeding to
use kinesis.
see https://aws.amazon.com/kinesis/
Luke Whaskavsky [Tue, 20 Feb 2024 10:45:54 +0000 (11:45 +0100)]
Update porn.txt
Pixelcode [Fri, 9 Feb 2024 21:45:48 +0000 (22:45 +0100)]
remove serveo.net from malware
SodaWithoutSparkles [Wed, 7 Feb 2024 11:26:45 +0000 (19:26 +0800)]
Replace dead links and update donations
GitHub Actions [Mon, 8 Jan 2024 13:52:34 +0000 (13:52 +0000)]
Automatically updated using GitHub Actions
Gap579137 [Mon, 8 Jan 2024 13:51:27 +0000 (07:51 -0600)]
Merge pull request #1081 from primeroz/remove-vlickhouse-from-lists
Remove Clickhouse.com from the lists since is not an advertisement network anymore.
Gap579137 [Mon, 8 Jan 2024 13:51:04 +0000 (07:51 -0600)]
Merge pull request #1071 from andyrb412/master
Update README.md
Gap579137 [Mon, 8 Jan 2024 13:50:20 +0000 (07:50 -0600)]
Merge pull request #1074 from CurryOnPatat/master-1
Create fortnite.txt
Gap579137 [Mon, 8 Jan 2024 13:49:51 +0000 (07:49 -0600)]
Merge pull request #1082 from IgniparousTempest/master
Added 4 new domains
Gap579137 [Mon, 8 Jan 2024 13:49:32 +0000 (07:49 -0600)]
Merge pull request #1086 from ymhcanada/master
Add "SS" websites (#1085)
Gap579137 [Mon, 8 Jan 2024 13:48:26 +0000 (07:48 -0600)]
Merge pull request #1088 from CasperMcFadden95/patch-1
Add www.torrentgalaxy.to to piracy.txt