Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

generate non-private subset #1881

Closed
paulirish opened this issue Nov 29, 2023 · 3 comments
Closed

generate non-private subset #1881

paulirish opened this issue Nov 29, 2023 · 3 comments

Comments

@paulirish
Copy link

paulirish commented Nov 29, 2023

(First off, your library is EXACTLY what we were looking for. Many folks have a PSL distribution on npm, but you've done awesome work here. Thank you!)

The PSL has all its public ICANN domains and then at the bottom a bunch of PRIVATE domains.

image

For our uses, we don't care about the private domains, as we just need the PSL for improved URL parsing/display for the publically accessible web. Also, we're very bundle size conscious. (So we appreciate the trie!) Publishing an icann-only subset (or whatever you want to name it) would be super helpful.

Here's an initial idea of the size difference:
image

cc @alexnj

@remusao
Copy link
Owner

remusao commented Dec 5, 2023

Hi @paulirish,

Thanks for reaching out, and for the kind words. I am happy that tldts is useful to you.

I have created a PR with preliminary work to create a separate tldts-icann which only contains the ICANN section: #1888

I'll have another look tomorrow but it's looking pretty good:

  • minified: 72K
  • gzipped (--best): 28K
  • brotli (-q 11): 24K
  • zstd (--ultra -22): 26K

I hope that helps,

@remusao
Copy link
Owner

remusao commented Dec 5, 2023

You can find the new package here: https://www.npmjs.com/package/tldts-icann

@paulirish
Copy link
Author

paulirish commented Dec 5, 2023 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants