Skip to content

Delete committed dataset orphans (Track X) - #164

Merged
mmcky merged 1 commit into
mainfrom
track-x-orphans
Sep 1, 2026
Merged

Delete committed dataset orphans (Track X)#164
mmcky merged 1 commit into
mainfrom
track-x-orphans

Conversation

@mmcky

@mmcky mmcky commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

Deletes nine committed files that no lecture in this edition reads: the pandas_panel trio (countries.csv, employ.csv, realwage.csvpandas_panel.md reads data-lectures), pandas/data/ticker_data.csv (unreferenced), pandas/data/test_pwt.csv (the copy left behind by the Track D repoint — QuantEcon/workspace-lectures#54's row for this edition), numbers.txt and us_cities.txt (written by %%file / %%writefile), and both test_table.csv copies — unlike the English repo, this edition's exercise prose links to the English repo's python_advanced_features/test_table.csv URL, so its own copies are orphans.

Translations sit outside the data-lectures audit's scanned set, so this is the translation half of the orphan sweep: the same files the English repo deletes in its PR of the same title, verified here file by file on 2026-09-01 — every lecture that uses these datasets reads them from QuantEcon/data-lectures, and the rest are written by the lectures themselves with %%file / %%writefile before being read. The translation sync is .md-only, so nothing will re-add them.

Published surface and settle. All nine serve at 200 on quantecon.github.io/lecture-python-programming.fa/ today. This repo publishes on a publish* tag and has no _build/html prune, so they clear on the settle policy — next Monday clean rebuild, then the next publish. That publish is the one QuantEcon/workspace-lectures#54 already asks for (it also refreshes the jax install cell on the rendered pages), so merging this and tagging clears both at once.

Rows for QuantEcon/workspace-lectures#40 (published URL, measured today with a 200 page control and a 404 never-existed control on the same host; expect 404 after the settle):

path today
/_static/lecture_specific/pandas_panel/countries.csv 200, 49,605 B
/_static/lecture_specific/pandas_panel/employ.csv 200, 1,725,234 B
/_static/lecture_specific/pandas_panel/realwage.csv 200, 121,589 B
/_static/lecture_specific/pandas/data/ticker_data.csv 200, 35,905 B
/_static/lecture_specific/pandas/data/test_pwt.csv 200, 793 B
/_static/lecture_specific/python_advanced_features/numbers.txt 200, 16 B
/_static/lecture_specific/python_advanced_features/test_table.csv 200, 377,272 B
/_static/lecture_specific/python_foundations/test_table.csv 200, 377,272 B
/_static/lecture_specific/python_foundations/us_cities.txt 200, 169 B

Deletion-time reader sweep (2026-09-01). Authenticated tarball-and-grep pass over 407 repositories: all 283 QuantEcon org repos (70 private, 26 archived; numfocus, quantecon-book-dp and test-cli are empty and unfetchable) plus 130 forks of the six holding repos (2 returned 404 and are recorded as not-swept rather than clean). Matched by basename, not URL, with each hit's three preceding lines folded in because URLs get split across source lines. Controls fired in the same pass: a never-existing basename returned 0 hits and 0 copies, and both known readers were found — the English python_advanced_features.md exercise link to test_table.csv, and devopseng99/project.lecture-wasm's runtime fetch of intro's graph.txt. Result: no repository reads any path this PR deletes. Every other co-occurrence of these basenames is a %%file embed, prose, a .gitignore line, or review text; the pre-MyST master/source/… reads in old course repos have been dead since the MyST migration and are unaffected.

Part of the Track X orphan sweep, QuantEcon/workspace-lectures#57 (one PR per holding repo, identical titles). Source list: https://quantecon.github.io/data-lectures/audit.json orphans, 2026-08-31 run.

🤖 Generated with Claude Code

These files are committed but read by nothing in this repository: every lecture that uses these datasets reads them from QuantEcon/data-lectures (verified per file on 2026-09-01), and the remaining files are written by the lectures themselves with %%file / %%writefile before being read. Translations sit outside the data-lectures audit's scanned set, so this is the translation half of the orphan sweep tracked at QuantEcon/workspace-lectures#57. An authenticated content sweep of 407 repositories (283 QuantEcon org repos plus the forks of the holding repos, by basename, positive and negative controls in the same pass) on 2026-09-01 found no reader of these paths.

Unlike the English repo, this translation's exercise prose links to the English repo's python_advanced_features/test_table.csv URL, so both local test_table.csv copies are orphans here. test_pwt.csv is the copy left behind by the Track D repoint (QuantEcon/workspace-lectures#54).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Copilot AI lite review requested due to automatic review settings September 1, 2026 00:08

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This pull request removes lecture-specific static datasets that are no longer read from this repository (either because the lectures now fetch from QuantEcon/data-lectures or because the lecture cells write the files at runtime via %%file / %%writefile). This reduces repository bloat and aligns the FA translation with the Track X “orphan sweep” cleanup.

Changes:

  • Delete legacy pandas_panel datasets (countries.csv, employ.csv, realwage.csv) that lectures now load from QuantEcon/data-lectures.
  • Delete unreferenced pandas datasets (ticker_data.csv, test_pwt.csv) that are no longer read locally.
  • Delete lecture-generated examples and orphaned exercise datasets (numbers.txt, us_cities.txt, and both test_table.csv copies).

Reviewed changes

Copilot reviewed 5 out of 9 changed files in this pull request and generated no comments.

Show a summary per file
File Description
lectures/_static/lecture_specific/pandas_panel/countries.csv Remove orphaned local copy; lecture reads from QuantEcon/data-lectures.
lectures/_static/lecture_specific/pandas_panel/employ.csv Remove orphaned local copy; exercise dataset is fetched from QuantEcon/data-lectures.
lectures/_static/lecture_specific/pandas_panel/realwage.csv Remove orphaned local copy; lecture reads from QuantEcon/data-lectures.
lectures/_static/lecture_specific/pandas/data/ticker_data.csv Remove unreferenced local dataset copy.
lectures/_static/lecture_specific/pandas/data/test_pwt.csv Remove orphaned local copy; lecture reads from QuantEcon/data-lectures.
lectures/_static/lecture_specific/python_advanced_features/numbers.txt Remove committed output of %%file example (lecture writes it at runtime).
lectures/_static/lecture_specific/python_advanced_features/test_table.csv Remove orphaned local copy; prose/exercise link points to the English repo URL.
lectures/_static/lecture_specific/python_foundations/test_table.csv Remove orphaned local copy; prose/exercise link points to the English repo URL.
lectures/_static/lecture_specific/python_foundations/us_cities.txt Remove committed output of %%writefile example (lecture writes it at runtime).

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown

@netlify

netlify Bot commented Sep 1, 2026

Copy link
Copy Markdown

Deploy Preview for majestic-griffin-10b166 ready!

Name Link
🔨 Latest commit b8afa00
🔍 Latest deploy log https://app.netlify.com/projects/majestic-griffin-10b166/deploys/6a9617734c22f200084c6ddc
😎 Deploy Preview https://deploy-preview-164--majestic-griffin-10b166.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@mmcky

mmcky commented Sep 1, 2026

Copy link
Copy Markdown
Contributor Author

Validation (2026-09-01, preview 6a961853…--majestic-griffin): pandas.html and pandas_panel.html → 200. Rendered pages read data-lectures everywhere the deleted files used to be: pandas.html (1 ref to data-lectures/raw/main/lectures/test_pwt.csv, 0 local), polars.html (3, 0), pandas_panel.html (3 data-lectures refs for realwage/countries/employ, 0 local); the python_advanced_features.html exercise href points at the English repo's kept test_table.csv (1) and never at a local copy (0). Build log: 0 warnings mentioning a deleted basename. Expected exception: all nine deleted paths still serve at 200 on the preview — it restored the 2026-08-26T05:11Z build-cache, built from main. (This is the stale-_build behaviour from QuantEcon/workspace-lectures#41: the preview restored the build-cache artifact built from main before this branch existed, and this repo has no jb clean . --html prune yet, so the restored copies are re-shipped. It says nothing about the PR; on the live site they clear on the settle policy recorded in the PR body.)

@mmcky
mmcky merged commit 90f2a9e into main Sep 1, 2026
8 checks passed
@mmcky
mmcky deleted the track-x-orphans branch September 1, 2026 00:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants