Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TC-CNET-4.9 and TC-CNET-4.11 Fail on verification step and incorrect value #455

Open
simonhmorris1 opened this issue Dec 5, 2024 · 0 comments

Comments

@simonhmorris1
Copy link

simonhmorris1 commented Dec 5, 2024

TC-CNET-4.9 and TC-CNET-4.11 issues

Test Step Error using "verification" key as neither "disabled: true" or "PICS: PICS_USER_PROMPT" are used.
Also two steps do not correctly check variable contents.

Description:

Three Errors

  • Error 1: Both tests fail with this
Executing Test Case: TC-CNET-4.9 (Semi-automated)
YAML Version: 50bcad170e6def6d56f2f5b34522a82aea9f3190
Executing Test Step: Start chip-tool test
Using PICS file: /var/tmp/pics
Test Step Error: Failed parsing with error: Step using "verification" key should either set "disabled: true" or "PICS: PICS_USER_PROMPT"
Executing Test Step: Precondition: TH reads FeatureMap attribute from the DUT
Test Step Completed [PASSED]: Precondition: TH reads FeatureMap attribute from the DUT
Test Case Completed[ERROR]: TC-CNET-4.9 (Semi-automated)
Unpairing DUT from server
  • Error 2 : TC-CNET-4.9 step 6, from the R1.3 Test plan states

Verify that DUT sends LastNetworkingStatus as Success which is 0 or null if 'NumNetworks' - 1 == 0 entries.

However the YAML script only checks for 0 and the chip-tool reports Null
Fix the YAML to use anyOf: [0, null]

  • Error 3 : TC-CNET-4.9 only step 7, from the R1.3 Test plan states

Verify that DUT sends LastNetworkID as PIXIT.CNET.WIFI_1ST_ACCESSPOINT_SSID or null if 'NumNetworks' - 1 == 0 entries.

However the YAML script only checks for WIFI_1ST_ACCESSPOINT_SSID and the chip-tool reports Null
Fix the YAML to use anyOf: [PIXIT.CNET.WIFI_1ST_ACCESSPOINT_SSID, null]

Steps to reproduce:

Run the tests through the GUI TH

Additional Info:

Matter Specification R1.3
Version: 2.10.2+spring2024 Sha: 2a350c8

Verification issue also reported in #345

PR for the proposed changes are here
project-chip/connectedhomeip#36739

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant