Skip to content

Emoji v17 / CLDR 48 - #193

Merged
milesj merged 8 commits into
milesj:masterfrom
itsfolf:v17
Nov 17, 2025
Merged

Emoji v17 / CLDR 48#193
milesj merged 8 commits into
milesj:masterfrom
itsfolf:v17

Conversation

@itsfolf

@itsfolf itsfolf commented Nov 9, 2025

Copy link
Copy Markdown
Contributor

I have attempted to begin work on #189

Judging by the v16 PR, the only thing missing should be po files/localization changes, as I did not understand exactly what needs to be done.

I am also currently using a mirror for emoji-test.txt as the official file looks to be temporarily unavailable.

@changeset-bot

changeset-bot Bot commented Nov 9, 2025

Copy link
Copy Markdown

鈿狅笍 No Changeset found

Latest commit: 27b93a1

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

).toFixed(1);

return fetchAndCache(
`https://unicode.org/Public/${version}.0.0/ucd/emoji/emoji-data.txt`,

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is the change here the patch version being included in the url?

@itsfolf itsfolf Nov 10, 2025

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, there's been a reorganization of the files but this one stayed in the same directory

@milesj

milesj commented Nov 9, 2025

Copy link
Copy Markdown
Owner

@itsfolf Thanks for starting this. I haven't had the time yet. A few things though:

@itsfolf

itsfolf commented Nov 10, 2025

Copy link
Copy Markdown
Contributor Author

@itsfolf Thanks for starting this. I haven't had the time yet. A few things though:

* The UTS 51 changes will need to be reflected in the generator code (if you haven't already). They can be found here: http://unicode.org/reports/tr51/#Modifications Sometimes no changes are required, other times a lot of changes are.

* The `.po` changes are very tedious. Some docs here: https://github.com/milesj/emojibase/blob/master/docs/new-major-checklist.md#update-groups-and-subgroups But it's a lot of trial and error. I basically have to reteach myself how it all works each time I touch this repo.

As far as I'm aware there don't seem to be any implementation modifications in tr51, however I am not sure what I'm looking for.

As for the po files, I have generated the updated versions with generate:po, filled in the entries for en, merged all other locales with msgmerge, and lastly regenerated the shortcodes. I believe this resulted in the desired state.

The official emoji-test.txt is still missing, so that's a blocker on merging for now.

@milesj

milesj commented Nov 10, 2025

Copy link
Copy Markdown
Owner

@itsfolf

The official emoji-test.txt is still missing, so that's a blocker on merging for now.

Yeah this is very weird. Have you found any announcement/post/etc about it not being available?

@itsfolf

itsfolf commented Nov 10, 2025

Copy link
Copy Markdown
Contributor Author

@itsfolf

The official emoji-test.txt is still missing, so that's a blocker on merging for now.

Yeah this is very weird. Have you found any announcement/post/etc about it not being available?

Not sure where to look. There seems to be some internal confusion that led to the deletion of the file, as both directories claim to have it.

https://www.unicode.org/Public/17.0.0/ucd/emoji/ReadMe.txt

# Unicode Character Database
# Date: 2025-08-15
# 漏 2025 Unicode庐, Inc.
# Unicode and the Unicode Logo are registered trademarks of Unicode, Inc. in the U.S. and other countries.
# For terms of use and license, see https://www.unicode.org/terms_of_use.html

This directory contains final data files for Unicode, Version 17.0

Public/17.0.0/emoji/

  emoji-data.txt
  emoji-variation-sequences.txt

The following related files are found in Unicode Emoji, Version 17.0

Public/17.0.0/ucd/emoji/

  emoji-sequences.txt
  emoji-zwj-sequences.txt
  emoji-test.txt

For documentation, see UTS #51 Unicode Emoji, Version 17.0

https://www.unicode.org/Public/17.0.0/emoji/ReadMe.txt

# Unicode Emoji
# 漏 2025 Unicode庐, Inc.
# Unicode and the Unicode Logo are registered trademarks of Unicode, Inc. in the U.S. and other countries.
# For terms of use and license, see https://www.unicode.org/terms_of_use.html

This directory contains final data files for Unicode Emoji, Version 17.0

Public/17.0.0/emoji/

emoji-sequences.txt
emoji-zwj-sequences.txt
emoji-test.txt

The following related files are found in the UCD for Version 17.0

Public/17.0.0/ucd/emoji/

emoji-data.txt
emoji-variation-sequences.txt

For documentation, see UTS #51 Unicode Emoji, Version 17.0

It was previously available under https://www.unicode.org/Public/17.0.0/emoji/emoji-test.txt according to Google caches.

@milesj

milesj commented Nov 10, 2025

Copy link
Copy Markdown
Owner

That's funny, and then it's not available in either, lol.

@itsfolf

itsfolf commented Nov 10, 2025

Copy link
Copy Markdown
Contributor Author

If you'd like to move forward with a mirror, https://distfiles.alpinelinux.org/distfiles/v3.23/emoji-test-17.0.0.txt is probably trustworthy enough. It was fetched on Oct 20

@milesj

milesj commented Nov 10, 2025

Copy link
Copy Markdown
Owner

@itsfolf Yeah that's fine. Seems like a legit distro.

@itsfolf

itsfolf commented Nov 10, 2025

Copy link
Copy Markdown
Contributor Author

@itsfolf Yeah that's fine. Seems like a legit distro.

Alright, should be ready for final review then.

@itsfolf
itsfolf marked this pull request as ready for review November 10, 2025 18:02
@RealityRipple

Copy link
Copy Markdown

It's back in /Public/17.0.0/emoji/, as well as /Public/emoji/latest/ (which is where I've always gone for my copies), but still not in /Public/17.0.0/ucd/emoji/. Keeping to the fork might be more advisable to buffer from live changes like that, though.

@itsfolf

itsfolf commented Nov 13, 2025

Copy link
Copy Markdown
Contributor Author

It's back in /Public/17.0.0/emoji/, as well as /Public/emoji/latest/ (which is where I've always gone for my copies), but still not in /Public/17.0.0/ucd/emoji/. Keeping to the fork might be more advisable to buffer from live changes like that, though.

I believe this is where it's meant to be

@milesj
milesj merged commit 50f5455 into milesj:master Nov 17, 2025
32 of 33 checks passed
@milesj

milesj commented Nov 17, 2025

Copy link
Copy Markdown
Owner

Thanks for the contrib!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants