Manual infra-estructure

[alfsb]

Planned changes, big and small, that affect manual infrastructure and languages.

Configure

• List of active languages on `doc-base (New tool local language repositories #186)
• Nested/recursive XIncludes (Recursive XInclude support and some automatix fixups for translations #194)
• XInclude failures less fatal on translations (Document and complement XInclude failures as warnings on translations #196)
• XInclude by xml:id (XInclude by xml:id  #198)
• Include post validation tools on configure.php (broken, revtag, entities). (Post check individual XML files for know issues #241)
• XML Entities (XML Entities, individual and grouped #183) (Enable XML Text Entities #301)
• Smaller XML output (comments, DTD, namespaces, docbook wsi) (Trim the XML output file #321)
• Recreate --langs-dir on configure.php and sub scripts

Idempotent build

• Create doc-base/temp and .gitkeep it (Idempotent build: doc-base/temp #200)
• Rewrite file-entities.ent.in to use temp/ (Idempotent build: file-entities.php #201)
• Change configure.php to be a little more idempotent (Idempotent build: configure.php #202)
• Change manual.xml.in into stable manual.xml (Idempotent build: manual.xml.in  #210)
• Move PhD files PhD repo (Add genphdfiles.php: generate PhD auxiliary files from doc-base phd#261)
• Move PhD files to doc-base/temp/
• Move .manual.xml to doc-base/temp/ (coordenate with PhD)
• Move remaining .gitignore files to temp/

Manual split and DTD entites

• Move manual.xml from doc-base to doc-en (Third-party manual, doc-base side #324)
• Move/merge XML files from doc-base to doc-en (Third-party manual, doc-en side doc-en#5682)
• Move/convert entitiy files from doc-base to doc-en (Minimize DTD sybsystem doc-en#5742)
• Minimize DTD inclusion on doc-base/manual.xml (Minimize DTD subsystem #336)
• Erase manual.xml, funcindex.xml and global.ent from doc-base (Various clean ups and docs #338)
• Remove all mentions of funcindex.xml from code (Various clean ups and docs #338)
• Split, convert and delete language-snippets.ent

Recheck

• Single source revcheck (Revcheck library and QA tools for translation synchronization  #111 Single source revcheck code/data #174 Remove backported revcheck compatibility #176 Rewrite and document git log parsing #180)
• Sequential [skip-revcheck] (Avoid marking files as outdated on multiple [skip-revcheck] #178)
• Accidental [skip-revcheck] (Only checks for [skip-revcheck] at start of commit messages #181)
• <?do-not-translate?> mark support on doc-base(Creates the do-not-translate mark #311)
• Annotate files on doc-en
• Remove file exclusions by name convention from revcheck lib (Remove filename conventions for do-not-translate in revcheck #319)
• "Do not translate" and "XML Broken" sections in revcheck (Add "Do not translate" and "XML Broken" sections to revcheck #334)

Performance/tools

• Avoid file entities for directories as individuai files (Create separated files for directory file-entities #218)
• Rewrite sync XML for Attributes (Command line tool for XML sync testing between languages: attributes #215)
• Rewrite sync XML for Entities (Command line tool for XML sync testing between languages: entities #219)
• Rewrite sync XML for Processing Instructions (Command line tools for XML sync testing between languages #222)
• Rewrite sync XML for Tags (Command line tools for XML sync testing between languages #222)
• Rewrite sync XML for Whitespace (Command line tools for XML sync testing between languages #222)
• Move generation of sources.xml and version.xml at the end of configure.php (PhD stuff at end of configure.php #239)
• Sync XML tools to accept language parameter and simple file listing (Add --lang and file listing to sync XML tools #275)
• Do-not-translate mark, broken test and revtag parse in one file load (Do not mark do-not-translate files not translated #339)

Clean up / TODOs

• Trim local repository status on configure.php (Show non default branch in git status #205)
• Remove $mixin from doc-base/scripts/file-entities.php (Windows related changes, ahead/behind only current branch #207)
• Remove BACKPORT from doc-base/scripts/file-entities.php (Remove backports, alert for insensitive file systems, and bundled file entity for directories #213)
• Rewrote $mixin as an check/error on all OS (Remove backports, alert for insensitive file systems, and bundled file entity for directories #213)
• Remove all mentions of <xi:fallback> in doc-en ([skip-revcheck] Remove empty xi:fallback elements doc-en#5699)
• Block <xi:fallback> on doc-en (Alert in xi:include fixups, block/warning against functional xi:fallback #332)

Future / R&D

• Make <?phpdoc more general
• Userland "XML assembler", that uses only XML Entities
• Recode CHM scripts, see PhD issue 203

Failed

• Native `DOMDocument->xinclude() (?)
• LIBXML_NOBLANKS (Add LIBXML_NOBLANKS to dom_load() XML parse options #304)
• LIBXML_NSCLEAN (LIBXML_NSCLEAN and DTD entities with namespaced attributes #315)
• GitHub actions/checkout merge stuck in the past (Make Github actions/checkout CI tests merge into master HEAD, instead of into the master past #329)