Skip to content

NXP backend: handle tests of mlperf tiny keyword spotting - #22519

Open
novak-vaclav wants to merge 1 commit into
pytorch:mainfrom
nxp-upstream:feature/EIEX-1030-redo-mlperf-tiny-kws-tests
Open

NXP backend: handle tests of mlperf tiny keyword spotting#22519
novak-vaclav wants to merge 1 commit into
pytorch:mainfrom
nxp-upstream:feature/EIEX-1030-redo-mlperf-tiny-kws-tests

Conversation

@novak-vaclav

Copy link
Copy Markdown
Collaborator

Summary

Enable and refactor MLPerf Tiny Keyword Spotting tests.

Test plan

tests can be manually run using pytest -c /dev/null backends/nxp/tests/

cc @robert-kalmar @JakeStevens @digantdesai @rascani @roman-janik-nxp

@novak-vaclav novak-vaclav added module: nxp Issues related to NXP Neutron NPU delegation and code under backends/nxp/ release notes: nxp Changes to the NXP Neutron backend delegate labels Sep 3, 2026
@pytorch-bot

pytorch-bot Bot commented Sep 3, 2026

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/22519

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure

As of commit bf6eae6 with merge base 55a969e (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 3, 2026
@linux-foundation-easycla

linux-foundation-easycla Bot commented Sep 3, 2026

Copy link
Copy Markdown

CLA Not Signed

@novak-vaclav
novak-vaclav force-pushed the feature/EIEX-1030-redo-mlperf-tiny-kws-tests branch from fbd62ce to bf6eae6 Compare September 7, 2026 12:37
@novak-vaclav
novak-vaclav marked this pull request as ready for review September 7, 2026 12:55
Copilot AI lite review requested due to automatic review settings September 7, 2026 12:55

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@novak-vaclav

novak-vaclav commented Sep 7, 2026

Copy link
Copy Markdown
Collaborator Author

Ready for review @roman-janik-nxp
Tests might fail for now, will definitely fail before #22435 is merged. Internal tests for it are running.

# non-scaled random weights tend to produce zero tensors,
# making it hard to compute numerical accuracy of the delegated model.
# Scaling the random weights makes the model produce reasonable results.
WEIGHT_INIT_SCALE = 2.0

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggestion:
Perhaps a custom "weight_init" function would be a cleaner way to achieve this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. module: nxp Issues related to NXP Neutron NPU delegation and code under backends/nxp/ release notes: nxp Changes to the NXP Neutron backend delegate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants