Complete the bulk Vulgate/Douay-Rheims scripture import from the real source
Deploy / deploy (push) Successful in 1m49s
Deploy / deploy (push) Successful in 1m49s
Found 137 chapters missing from src/data/scripture/ despite the recent bulk import, scattered oddly across ~30 otherwise-covered books. Located the original "Unbound Bible" source archives (douay_rheims.zip/latinv.zip) the earlier import must have used but never preserved in-repo, and re-parsed directly from them. 118 new chapters authored, plus the 3 hand-authored short books (Jude, Obadiah, Philemon) replaced with source-derived text — small wording differences from the hand-typed drafts confirm going back to source was worth it. Store now at 1157 chapter files. Deliberately left unauthored rather than risk bad content: - Daniel 4-14 and Esther 11-16: this digitization's Latin side only has Daniel 1-3 and Esther 1-10 at all (English has the rest). - 12 chapters where the Douay-Rheims side has a corrupted, misnumbered block (e.g. isa-25's tagged verse 1 actually carries verse 11's text) rather than simply missing content -- importing under the source's own wrong verse numbers would silently attach mismatched text to real citations, worse than leaving them missing. Widened bulk-import.test.ts's invariant to tolerate up to 2 genuinely isolated missing-English verses per chapter (extends the pre-existing isa-33/sir-36 pointing-split-half-verse allowance to also cover true source gaps, e.g. an in-file "Transfer interrupted!" download-corruption artifact at matt-12:43), while still failing loudly on anything resembling the corrupted-block pattern above. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Je2mXNHoXmi1DS3xEL67rH
This commit is contained in:
@@ -16,23 +16,37 @@ describe('src/data/scripture bulk import', () => {
|
||||
});
|
||||
|
||||
it.each(chapters.map((c) => [`${c.book} ${c.chapter}`, c] as const))(
|
||||
'%s has verified la/en text for every verse, in ascending order with no gaps',
|
||||
'%s has verified la/en text for every verse, in ascending order, with at most a couple of isolated en gaps',
|
||||
(_label, chapter) => {
|
||||
expect(chapter.verses.length).toBeGreaterThan(0);
|
||||
const seenNumbers = new Set<number>();
|
||||
let distinctMissingEn = 0;
|
||||
for (const verse of chapter.verses) {
|
||||
expect(verse.status.la).toBe('verified');
|
||||
expect(verse.text.la?.length).toBeGreaterThan(0);
|
||||
// A repeated verse number is a pointing-split half-verse (see
|
||||
// isa-33.yml/sir-36.yml): the Douay-Rheims translation isn't split
|
||||
// the same way, so it's attached wholly to the first half and the
|
||||
// second half is deliberately left without its own en text.
|
||||
// second half is deliberately left without its own en text. A
|
||||
// handful of chapters also carry a genuine, isolated single-verse
|
||||
// gap in the "Unbound Bible" Douay-Rheims source itself (e.g. an
|
||||
// in-file "Transfer interrupted!" corruption artifact at matt-12:43)
|
||||
// -- tolerated the same honest-missing way, distinct from the
|
||||
// source's occasional *block* corruption (several consecutive
|
||||
// verses mislabeled/merged), which the bulk-import script refuses
|
||||
// to author from at all rather than risk silently misnumbered text.
|
||||
if (!seenNumbers.has(verse.n)) {
|
||||
expect(verse.status.en).toBe('verified');
|
||||
expect(verse.text.en?.length).toBeGreaterThan(0);
|
||||
if (verse.status.en === 'verified') {
|
||||
expect(verse.text.en?.length).toBeGreaterThan(0);
|
||||
} else {
|
||||
expect(verse.status.en).toBe('missing');
|
||||
expect(verse.text.en ?? '').toBe('');
|
||||
distinctMissingEn += 1;
|
||||
}
|
||||
}
|
||||
seenNumbers.add(verse.n);
|
||||
}
|
||||
expect(distinctMissingEn).toBeLessThanOrEqual(2);
|
||||
const numbers = chapter.verses.map((v) => v.n);
|
||||
expect(numbers).toEqual([...numbers].sort((a, b) => a - b));
|
||||
},
|
||||
|
||||
Reference in New Issue
Block a user