Skip to content

Add new TLS tests to all driver API system tests - #2214

Merged
marcoskirsch merged 45 commits into
ni:masterfrom
ryanwixon-emerson:addAllTLS
Sep 22, 2026
Merged

marcoskirsch merged 45 commits into
ni:masterfrom
ryanwixon-emerson:addAllTLS

Conversation

@ryanwixon-emerson

@ryanwixon-emerson ryanwixon-emerson commented Sep 18, 2026

Copy link
Copy Markdown
Contributor
  • This contribution adheres to CONTRIBUTING.md.

  • I've updated CHANGELOG.md if applicable.

  • I've added tests applicable for this pull request

What does this Pull Request accomplish?

This PR implements TLS-enabled gRPC tests for every driver API which includes grpc-device related testing:

  • nidcpower
  • nidigital
  • nifgen
  • nirfsa
  • nirfsg
  • niscope
  • niswitch

The implementations follow the pattern first established by the trial driver, NI-DMM, in a previous PR (#2208):

  • Choose a small subset of tests from the main test runner to migrate to a new BasicValidationTests class
  • Add two new test classes to test ni-tls-config enabled workflows (one for enabled mTLS and one for disabled mTLS)

(This PR also makes a minor change to the NI-DMM tests by adding the self test function to the BasicValidationTests class. This is to bring it in line with these drivers, since I decided that it would be a good idea for everything to run it as a part of all of their tests).

List issues fixed by this Pull Request below, if any.

N/A - This PR does not address any issues.

What testing has been done?

The PR CI pipelines successfully ran and indicated that the new tests are running correctly. This is sufficient because the implementation details are identical to that of NI-DMM, which was thoroughly tested with Wireshark to validate that the tests are using the proper TLS configurations and use real encrypted communication.

@codecov-commenter

codecov-commenter commented Sep 18, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.94%. Comparing base (28193cb) to head (b4120bc).

❗ There is a different number of reports uploaded between BASE (28193cb) and HEAD (b4120bc). Click for more details.

HEAD has 13 uploads less than BASE
Flag BASE (28193cb) HEAD (b4120bc)
niscopeunittests 5 4
codegenunittests 1 0
nisesystemtests 1 0
nimodinstsystemtests 1 0
niswitchsystemtests 1 0
nirfsgsystemtests 1 0
nidmmsystemtests 1 0
nifgensystemtests 1 0
niscopesystemtests 1 0
nirfsasystemtests 1 0
nidigitalsystemtests 1 0
nidcpowersystemtests 1 0
nitclksystemtests 1 0
Additional details and impacted files
@@             Coverage Diff             @@
##           master    #2214       +/-   ##
===========================================
- Coverage   88.13%   71.94%   -16.19%     
===========================================
  Files          88       32       -56     
  Lines       22828     4959    -17869     
===========================================
- Hits        20119     3568    -16551     
+ Misses       2709     1391     -1318     
Flag Coverage Δ
codegenunittests ?
nidcpowersystemtests ?
nidcpowerunittests 89.53% <ø> (ø)
nidigitalsystemtests ?
nidigitalunittests 68.43% <ø> (ø)
nidmmsystemtests ?
nifakeunittests 86.08% <ø> (ø)
nifgensystemtests ?
nimodinstsystemtests ?
nimodinstunittests 94.20% <ø> (ø)
nirfsasystemtests ?
nirfsaunittests 63.40% <ø> (ø)
nirfsgsystemtests ?
niscopesystemtests ?
niscopeunittests 43.20% <ø> (ø)
nisesystemtests ?
niswitchsystemtests ?
nitclksystemtests ?
nitclkunittests 98.26% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@ryanwixon-emerson
ryanwixon-emerson marked this pull request as ready for review September 18, 2026 20:21
Comment thread src/nidcpower/system_tests/test_system_nidcpower.py Outdated
@ni-jfitzger

Copy link
Copy Markdown
Collaborator

Might be worth including test_allocate_arb_waveform in nirfsa BasicValidationTests so that we test transferring some actual data.

Comment thread src/niscope/system_tests/test_system_niscope.py
Comment thread src/niscope/system_tests/test_system_niscope.py Outdated
@ni-jfitzger

Copy link
Copy Markdown
Collaborator

Overall, this looks pretty good.

@ni-jfitzger ni-jfitzger changed the title Add new TLS tests to all driver system tests Add new TLS tests to all driver API system tests Sep 22, 2026
@marcoskirsch
marcoskirsch merged commit 9f7b5b8 into ni:master Sep 22, 2026
49 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants