Skip to content

List credentials written in two chunks joined at a full stop (#998) - #1297

Merged
derek73 merged 5 commits into
masterfrom
fix/issue-998-credential-batch
Nov 10, 2026
Merged

derek73 merged 5 commits into
masterfrom
fix/issue-998-credential-batch

Conversation

@derek73

@derek73 derek73 commented Nov 10, 2026 •

Copy link
Copy Markdown
Owner

Closes #998

Lists the credentials written in two chunks joined at a full stop that #998 measured and the six local corpora show, so the vocabulary reads each word whole before rules/S3's shape does. This is step 2 of decisions/period-joined-words (#1291): the division of a word at its full stop has to come after this batch.

What changes

  • 43 listed, each vetted on its entry (tools/vocab/query.py, tools/name_usage.py, counts in the note), each with a cased mask except msci and msi:
    • 26 in en.toml: bpharm, cpsych, mpharm, msci, mtech, dtech, dsci, mmath, moptom, and others.
    • 16 in id.toml: mkes, mkep, mkom, skom, mpd, spd, mhum, mkn, msi, and others.
    • menf in pt.toml.
  • msi marked ambiguous by a family reading, Msi being a Xhosa surname. Refusing it reversed Jane Doe, MSi. Marking it costs ANDISWA ZANELE MSI its surname, which no local corpus writes; a row pins that as the accepted cost.
  • 12 refused with excluded entries, because the spelling without stops is a name or another word:
    • peng, ceng: Chinese surnames.
    • barch, bchir, mendo, sked, shut, merg, mak, mor: borne as names.
    • bed: the Nepali given name.
    • ssi: the romanized Korean honorific 씨, as in Park Ji-hoon ssi.
  • btech left unlisted on purpose. B.Tech is the example of an unlisted dotted credential in eleven files, including comments in _pipeline/_vocab.py and _render.py. Moving those examples is a follow-up of its own.
input before after
Ahmed Ali B.Pharm suffix 'B.Pharm', suffix-or-name suffix 'B.Pharm', no report
Ayu Pangestu, S.Pd, M.Pd title 'S.Pd M.Pd' (the chunk pd is a title) suffix 'S.Pd, M.Pd'
Anna Gelavis, BPharm given 'BPharm', family 'Anna Gelavis' given 'Anna', family 'Gelavis', suffix 'BPharm'
Ali C.Psych family 'C.Psych' suffix 'C.Psych'
Ahmed Ali M.Hassan suffix 'M.Hassan', reported unchanged (the cost #998 accepts)

Measured (2026-11-09)

tools/differential/measure.py --base against master b89c548, then the corpora that moved again on the final tree.

  • Snapshots: the committed snapshot and the CLDR, GND and Wikidata records do not move.
  • ctgov-officials: 407 readings move, 122 of them in a field. Each one sampled is a credential leaving a name field or the title for the suffix.
  • orcid-researchers: 81 move, 50 of them in a field, mostly Indonesian degrees that had read as titles.
  • Other moves: cz-candidates 2; jrc-names 1 (Bernd Lange SPD: family 'Lange', suffix 'SPD'); psc-individuals 1, its report only (Mr Afikile Manduleli Msi).
  • Agreement: orcid-researchers +9, −1 (a one-word name with credentials). cz-candidates +1. psc-individuals and patentsview-inventors unchanged.
  • opensanctions-parliaments not measured: the shared cache predates the datasets the tool reads.

The division's cost, which decisions/period-joined-words' Open line on unlisted credentials asks for, is in that file's new Log bullet. Over the six corpora #998 counted:

  • Cost: 18 unlisted credentials would read as name words (P.Eng 4, B.Chir 2, …). With second chunks of any length, the cost is 44 (M.Ed 8, B.Ch 5, …), 42 of them after a comma.
  • Gain: 63 glued initials would get their surname back.

For a decision

bed is refused for the given part after a family comma (Thapa, Bed reads suffix 'Bed' with the word listed), though no local corpus writes that shape, against a gain of 6 readings (3 in a field). decisions/suffix-acronym-collisions' Standing line for ded says a given name is not a position the suffix claim acts on, and Thapa, Ded reads suffix 'Ded' today. That Standing line is corrected to say the claim reaches a given name after a family comma and under a family-first order (Luli Ded), for edd too, and both stay unmarked; whether to reopen them is yours.

Docs

  • decisions/period-joined-words and decisions/suffix-acronym-collisions each gained a Log bullet.
  • nameparser/vocab/AGENTS.md now says to vet a dotted credential's spelling without stops.
  • docs/release_log.rst has a new bullet.
  • No rule's stated limits move: rules/S3 still reads the unlisted shape.

Reviewed by design-docs-reviewer (twice), pr-test-analyzer and code-reviewer; their findings are fixed in the second and third commits. The period-joined-words Open line moves from #998 to #1255, since this PR closes #998.

🤖 Generated with Claude Code

derek73 and others added 2 commits November 9, 2026 21:54
43 credentials such as B.Pharm, C.Psych, M.Tech, M.Kes, S.Kom and M.Pd
are listed, so the vocabulary reads them whole before rules/S3's shape:
Ahmed Ali B.Pharm reads suffix 'B.Pharm' with no suffix-or-name report,
Ayu Pangestu, S.Pd, M.Pd reads suffix 'S.Pd, M.Pd' where the title chunk
pd made it a title, and Anna Gelavis, BPharm no longer reverses. msi is
marked ambiguous (Msi, a Xhosa surname); twelve folds that are names or
another word are refused (peng, ceng, barch, bchir, mendo, bed, ssi,
sked, shut, merg, mak, mor). decisions/period-joined-words records the
division's cost against the batch.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The test review found msi, marked ambiguous, still took the Xhosa
surname from a name in one case (ANDISWA ZANELE MSI), the shape cota was
refused for, so it is refused too. New case rows pin the spelling
without stops (Anna Gelavis, BPharm; JOHN SMITH MPHARM), the no-comma
and one-word-head shapes, and the refusals of ssi, msi and bed (Thapa,
Bed, a real control where Bed Bahadur Thapa was not); a render test pins
the masks. msci loses its mask (written MSCI far more often), the M.Hassan
row is fix(#516), and the release bullet names the release ranges. The
division figure now leaves out every token the suffix sets list (L.Ac)
and counts M.Si, which msi's refusal leaves unlisted.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@derek73 derek73 added the vocabulary Fixed by a word-list entry: per-word vocabulary and language packs label Nov 10, 2026
@derek73 derek73 self-assigned this Nov 10, 2026
derek73 and others added 3 commits November 9, 2026 22:23
The second review measured that refusing msi cost comma names (Jane Doe,
MSi reversed; Saprudin S.Sos., M.Si. read given 'M.Si.') while the
capitals shape marking costs is written in no local corpus, so msi is
marked ambiguous with no mask, and three rows pin it, the capitals one
as the accepted cost. The ded Standing line is corrected to the position
the suffix claim reaches (Thapa, Ded) and a Standing line records the
batch; the period-joined-words Open line moves to #1255, since this PR
closes #998; the division figure leaves M.Si out as listed (44 credentials
at any chunk length) and counts the refused tokens by subset; bed's gain
is 10 records; the corpora are measured again on the final tree.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
period-joined-words: master retired #1136's Open line (answered), this
branch moved the #998 line to #1255; both kept.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The third review measured the suffix claim reaching a trailing given
name under a family-first order too (Luli Ded), and edd as ded; the
#540 entry gets a head note naming the corrected premise. bed's gain is
6 readings of the 10 records, 3 in a field. A pointer to the renamed
Open line is restated.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@derek73 derek73 added this to the 3.1 milestone Nov 10, 2026
@derek73
derek73 merged commit 153e50f into master Nov 10, 2026
13 checks passed
@derek73
derek73 deleted the fix/issue-998-credential-batch branch November 10, 2026 07:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

vocabulary Fixed by a word-list entry: per-word vocabulary and language packs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Should B.Pharm, C.Psych and M.Kes be listed credentials, now that Ahmed Ali M.Hassan loses its surname to the same guess?

1 participant