Test Case Software Update 2.5 #41182

jtrejoespinoza-grid · 2025-09-29T21:51:34Z

Summary

This test case automates the Test Case SU 2.5.
Verify the DUT behaves according the spec when is applying the software update.
In this test case Im using event handlers to verify the updates are happening in the expected timeframes, for this case Im validating updates are not happening and start in the limits of the expected values.

Related issues

Fixes: project-chip/matter-test-scripts#656

Testing

Launch the requestor:

./out/debug/chip-ota-requestor-app --discriminator 123 --passcode 2123 --secured-device-port 5540 --KVS /tmp/chip_kvs_requestor --autoApplyImage

Launch the test case

python3 src/python_testing/TC_SU_2_5.py --commissioning-method on-network --passcode 2123 --discriminator 123 --endpoint 0 --nodeId 123

…ed image was deleted

…vent tracking as comments.

…tionCluster.Softwareversion to update it and verify it did not happend in less than the delaytime

github-actions · 2025-10-02T00:33:36Z

PR #41182: Size comparison from 7756885 to 6e457eb

Full report (5 builds for cc32xx, realtek, stm32)

platform	target	config	section	`7756885`	`6e457eb`
cc32xx	air-purifier	CC3235SF_LAUNCHXL	FLASH	552986	552986
			RAM	204928	204928
	lock	CC3235SF_LAUNCHXL	FLASH	585630	585630
			RAM	205160	205160
realtek	light-switch-app	rtl8777g	FLASH	704072	704072
			RAM	106720	106720
	lighting-app	rtl8777g	FLASH	755248	755248
			RAM	127084	127084
stm32	light	STM32WB5MM-DK	FLASH	467692	467692
			RAM	141160	141160

This reverts commit d43bfca.

github-actions · 2025-10-11T01:37:46Z

PR #41182: Size comparison from bcb7758 to 1d9ff88

Full report (1 build for stm32)

platform	target	config	section	`bcb7758`	`1d9ff88`	change	% change
stm32	light	STM32WB5MM-DK	FLASH	469028	469068	40	0.0
			RAM	141200	141208	8	0.0

This reverts commit 56823c7.

github-actions · 2025-10-17T17:32:49Z

PR #41182: Size comparison from c15b122 to 0ca5c31

Full report (1 build for stm32)

platform	target	config	section	`c15b122`	`0ca5c31`	change	% change
stm32	light	STM32WB5MM-DK	FLASH	469812	469812	0	0.0
			RAM	141248	141248	0	0.0

This reverts commit e044f1c.

github-actions · 2025-10-24T20:25:42Z

PR #41182: Size comparison from b9971ce to 323f26d

Full report (37 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, esp32, nrfconnect, nxp, psoc6, qpg, realtek, stm32, telink)

platform	target	config	section	`b9971ce`	`323f26d`	change	% change
bl602	lighting-app	bl602+mfd+littlefs+rpc	FLASH	1106622	1106622	0	0.0
			RAM	178874	178874	0	0.0
bl702	lighting-app	bl702+eth	FLASH	661198	661198	0	0.0
			RAM	134969	134969	0	0.0
		bl702+wifi	FLASH	837310	837310	0	0.0
			RAM	124405	124405	0	0.0
		bl706+mfd+rpc+littlefs	FLASH	1070278	1070278	0	0.0
			RAM	117261	117261	0	0.0
bl702l	contact-sensor-app	bl702l+mfd+littlefs	FLASH	899730	899730	0	0.0
			RAM	105524	105524	0	0.0
	lighting-app	bl702l+mfd+littlefs	FLASH	983040	983040	0	0.0
			RAM	109740	109740	0	0.0
cc13x4_26x4	lighting-app	LP_EM_CC1354P10_6	FLASH	770652	770652	0	0.0
			RAM	103304	103304	0	0.0
	lock-ftd	LP_EM_CC1354P10_6	FLASH	782384	782384	0	0.0
			RAM	108472	108472	0	0.0
	pump-app	LP_EM_CC1354P10_6	FLASH	728212	728212	0	0.0
			RAM	97364	97364	0	0.0
	pump-controller-app	LP_EM_CC1354P10_6	FLASH	712672	712672	0	0.0
			RAM	97580	97580	0	0.0
cc32xx	air-purifier	CC3235SF_LAUNCHXL	FLASH	554226	554226	0	0.0
			RAM	205736	205736	0	0.0
	lock	CC3235SF_LAUNCHXL	FLASH	587474	587474	0	0.0
			RAM	205832	205832	0	0.0
efr32	lock-app	BRD4187C	FLASH	963160	963160	0	0.0
			RAM	123512	123512	0	0.0
		BRD4338a	FLASH	756744	756744	0	0.0
			RAM	254136	254136	0	0.0
	window-app	BRD4187C	FLASH	1058492	`1058484`	-8	-0.0
			RAM	119740	119740	0	0.0
esp32	all-clusters-app	c3devkit	DRAM	102516	102516	0	0.0
			FLASH	1827430	1827430	0	0.0
			IRAM	93540	93540	0	0.0
nrfconnect	all-clusters-app	nrf52840dk_nrf52840	FLASH	933076	933076	0	0.0
			RAM	161313	161313	0	0.0
nxp	contact	mcxw71+release	FLASH	691904	691904	0	0.0
			RAM	61496	61496	0	0.0
	lighting	mcxw71+release	FLASH	723408	723408	0	0.0
			RAM	68140	68140	0	0.0
	lock	mcxw71+release	FLASH	773672	773672	0	0.0
			RAM	61932	61932	0	0.0
psoc6	all-clusters	cy8ckit_062s2_43012	FLASH	`1676564`	`1676564`	0	0.0
			RAM	213900	213900	0	0.0
	all-clusters-minimal	cy8ckit_062s2_43012	FLASH	1593180	1593180	0	0.0
			RAM	211108	211108	0	0.0
	light	cy8ckit_062s2_43012	FLASH	`1459724`	`1459724`	0	0.0
			RAM	197728	197728	0	0.0
	lock	cy8ckit_062s2_43012	FLASH	1492276	1492276	0	0.0
			RAM	225440	225440	0	0.0
qpg	lighting-app	qpg6200+debug	FLASH	837104	837104	0	0.0
			RAM	127708	127708	0	0.0
	lock-app	qpg6200+debug	FLASH	773884	773884	0	0.0
			RAM	118684	118684	0	0.0
realtek	light-switch-app	rtl8777g	FLASH	706624	706624	0	0.0
			RAM	106904	106904	0	0.0
	lighting-app	rtl8777g	FLASH	757712	757712	0	0.0
			RAM	127236	127236	0	0.0
stm32	light	STM32WB5MM-DK	FLASH	470092	470092	0	0.0
			RAM	141304	141304	0	0.0
telink	bridge-app	tl7218x	FLASH	710570	710570	0	0.0
			RAM	90544	90544	0	0.0
	light-app-ota-compress-lzma-shell-factory-data	tl3218x	FLASH	796924	796924	0	0.0
			RAM	41000	41000	0	0.0
	light-app-ota-shell-factory-data	tl7218x	FLASH	788124	788124	0	0.0
			RAM	93644	93644	0	0.0
	light-switch-app-ota-compress-lzma-factory-data	tl7218x_retention	FLASH	715002	715002	0	0.0
			RAM	51844	51844	0	0.0
	light-switch-app-ota-compress-lzma-shell-factory-data	tlsr9528a	FLASH	748298	748298	0	0.0
			RAM	70892	70892	0	0.0
	light-switch-app-ota-factory-data	tl3218x_retention	FLASH	725154	725154	0	0.0
			RAM	34592	34592	0	0.0
	lighting-app-ota-factory-data	tlsr9118bdk40d	FLASH	602398	602398	0	0.0
			RAM	108904	108904	0	0.0
	lighting-app-ota-rpc-factory-data-4mb	tlsr9518adk80d	FLASH	820728	820732	4	0.0
			RAM	92040	92040	0	0.0

github-actions · 2025-11-05T15:54:43Z

PR #41182: Size comparison from 2c0b7fc to 4525982

Full report (35 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, esp32, nrfconnect, nxp, psoc6, qpg, realtek, stm32, telink)

platform	target	config	section	`2c0b7fc`	`4525982`	change
bl602	lighting-app	bl602+mfd+littlefs+rpc	FLASH	1106262	1106262	0
			RAM	178914	178914	0
bl702	lighting-app	bl702+eth	FLASH	661392	661392	0
			RAM	135017	135017	0
		bl702+wifi	FLASH	836934	836934	0
			RAM	124437	124437	0
		bl706+mfd+rpc+littlefs	FLASH	1070472	1070472	0
			RAM	117293	117293	0
bl702l	contact-sensor-app	bl702l+mfd+littlefs	FLASH	899904	899904	0
			RAM	105572	105572	0
	lighting-app	bl702l+mfd+littlefs	FLASH	983218	983218	0
			RAM	109772	109772	0
cc13x4_26x4	lighting-app	LP_EM_CC1354P10_6	FLASH	770616	770616	0
			RAM	103344	103344	0
	lock-ftd	LP_EM_CC1354P10_6	FLASH	782452	782452	0
			RAM	108512	108512	0
	pump-app	LP_EM_CC1354P10_6	FLASH	728384	728384	0
			RAM	97404	97404	0
	pump-controller-app	LP_EM_CC1354P10_6	FLASH	712860	712860	0
			RAM	97620	97620	0
cc32xx	air-purifier	CC3235SF_LAUNCHXL	FLASH	554894	554894	0
			RAM	205776	205776	0
	lock	CC3235SF_LAUNCHXL	FLASH	587774	587774	0
			RAM	205872	205872	0
efr32	lock-app	BRD4187C	FLASH	963296	963296	0
			RAM	123544	123544	0
		BRD4338a	FLASH	757480	757480	0
			RAM	254184	254184	0
	window-app	BRD4187C	FLASH	1058532	1058532	0
			RAM	119772	119772	0
esp32	all-clusters-app	c3devkit	DRAM	102556	102556	0
			FLASH	1836588	1836588	0
			IRAM	93540	93540	0
nrfconnect	all-clusters-app	nrf52840dk_nrf52840	FLASH	933240	933240	0
			RAM	161361	161361	0
nxp	contact	mcxw71+release	FLASH	692208	692208	0
			RAM	61536	61536	0
psoc6	all-clusters	cy8ckit_062s2_43012	FLASH	`1677828`	`1677828`	0
			RAM	213940	213940	0
	all-clusters-minimal	cy8ckit_062s2_43012	FLASH	1594220	1594220	0
			RAM	211148	211148	0
	light	cy8ckit_062s2_43012	FLASH	1460460	1460460	0
			RAM	197768	197768	0
	lock	cy8ckit_062s2_43012	FLASH	1493140	1493140	0
			RAM	225480	225480	0
qpg	lighting-app	qpg6200+debug	FLASH	837544	837544	0
			RAM	127748	127748	0
	lock-app	qpg6200+debug	FLASH	774356	774356	0
			RAM	118724	118724	0
realtek	light-switch-app	rtl8777g	FLASH	706728	706728	0
			RAM	106952	106952	0
	lighting-app	rtl8777g	FLASH	757672	757672	0
			RAM	127284	127284	0
stm32	light	STM32WB5MM-DK	FLASH	470056	470056	0
			RAM	141344	141344	0
telink	bridge-app	tl7218x	FLASH	710586	710586	0
			RAM	90584	90584	0
	light-app-ota-compress-lzma-shell-factory-data	tl3218x	FLASH	797060	797060	0
			RAM	41008	41008	0
	light-app-ota-shell-factory-data	tl7218x	FLASH	788262	788262	0
			RAM	93684	93684	0
	light-switch-app-ota-compress-lzma-factory-data	tl7218x_retention	FLASH	715264	715264	0
			RAM	51876	51876	0
	light-switch-app-ota-compress-lzma-shell-factory-data	tlsr9528a	FLASH	748560	748560	0
			RAM	70916	70916	0
	light-switch-app-ota-factory-data	tl3218x_retention	FLASH	725414	725414	0
			RAM	34608	34608	0
	lighting-app-ota-factory-data	tlsr9118bdk40d	FLASH	602692	602692	0
			RAM	108912	108912	0
	lighting-app-ota-rpc-factory-data-4mb	tlsr9518adk80d	FLASH	820896	820900	4
			RAM	92080	92080	0

…launched with --secure-device-port. Removed break in monitor_app_requestor to allow multiple restarts

github-actions · 2025-11-06T19:39:02Z

PR #41182: Size comparison from 2c0b7fc to 9359df4

Full report (35 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, esp32, nrfconnect, nxp, psoc6, qpg, realtek, stm32, telink)

platform	target	config	section	`2c0b7fc`	`9359df4`	change	% change
bl602	lighting-app	bl602+mfd+littlefs+rpc	FLASH	1106262	1106340	78	0.0
			RAM	178914	178930	16	0.0
bl702	lighting-app	bl702+eth	FLASH	661392	661414	22	0.0
			RAM	135017	135025	8	0.0
		bl702+wifi	FLASH	836934	837008	74	0.0
			RAM	124437	124445	8	0.0
		bl706+mfd+rpc+littlefs	FLASH	1070472	1070610	138	0.0
			RAM	117293	117317	24	0.0
bl702l	contact-sensor-app	bl702l+mfd+littlefs	FLASH	899904	900042	138	0.0
			RAM	105572	105612	40	0.0
	lighting-app	bl702l+mfd+littlefs	FLASH	983218	983356	138	0.0
			RAM	109772	109796	24	0.0
cc13x4_26x4	lighting-app	LP_EM_CC1354P10_6	FLASH	770616	770820	204	0.0
			RAM	103344	103360	16	0.0
	lock-ftd	LP_EM_CC1354P10_6	FLASH	782452	782664	212	0.0
			RAM	108512	108528	16	0.0
	pump-app	LP_EM_CC1354P10_6	FLASH	728384	728612	228	0.0
			RAM	97404	97420	16	0.0
	pump-controller-app	LP_EM_CC1354P10_6	FLASH	712860	713080	220	0.0
			RAM	97620	97636	16	0.0
cc32xx	air-purifier	CC3235SF_LAUNCHXL	FLASH	554894	554906	12	0.0
			RAM	205776	205776	0	0.0
	lock	CC3235SF_LAUNCHXL	FLASH	587774	587786	12	0.0
			RAM	205872	205872	0	0.0
efr32	lock-app	BRD4187C	FLASH	963296	963504	208	0.0
			RAM	123544	123572	28	0.0
		BRD4338a	FLASH	757480	757752	272	0.0
			RAM	254184	254196	12	0.0
	window-app	BRD4187C	FLASH	1058532	1058820	288	0.0
			RAM	119772	119800	28	0.0
esp32	all-clusters-app	c3devkit	DRAM	102556	102572	16	0.0
			FLASH	1836588	1836720	132	0.0
			IRAM	93540	93540	0	0.0
nrfconnect	all-clusters-app	nrf52840dk_nrf52840	FLASH	933240	933452	212	0.0
			RAM	161361	161377	16	0.0
nxp	contact	mcxw71+release	FLASH	692208	692504	296	0.0
			RAM	61536	61552	16	0.0
psoc6	all-clusters	cy8ckit_062s2_43012	FLASH	`1677828`	`1678092`	264	0.0
			RAM	213940	213956	16	0.0
	all-clusters-minimal	cy8ckit_062s2_43012	FLASH	1594220	1594492	272	0.0
			RAM	211148	211156	8	0.0
	light	cy8ckit_062s2_43012	FLASH	1460460	1460732	272	0.0
			RAM	197768	197776	8	0.0
	lock	cy8ckit_062s2_43012	FLASH	1493140	1493420	280	0.0
			RAM	225480	225496	16	0.0
qpg	lighting-app	qpg6200+debug	FLASH	837544	837768	224	0.0
			RAM	127748	127768	20	0.0
	lock-app	qpg6200+debug	FLASH	774356	774580	224	0.0
			RAM	118724	118736	12	0.0
realtek	light-switch-app	rtl8777g	FLASH	706728	706952	224	0.0
			RAM	106952	106964	12	0.0
	lighting-app	rtl8777g	FLASH	757672	757896	224	0.0
			RAM	127284	127296	12	0.0
stm32	light	STM32WB5MM-DK	FLASH	470056	470224	168	0.0
			RAM	141344	141352	8	0.0
telink	bridge-app	tl7218x	FLASH	710586	710608	22	0.0
			RAM	90584	90600	16	0.0
	light-app-ota-compress-lzma-shell-factory-data	tl3218x	FLASH	797060	797084	24	0.0
			RAM	41008	41024	16	0.0
	light-app-ota-shell-factory-data	tl7218x	FLASH	788262	788286	24	0.0
			RAM	93684	93700	16	0.0
	light-switch-app-ota-compress-lzma-factory-data	tl7218x_retention	FLASH	715264	715286	22	0.0
			RAM	51876	51892	16	0.0
	light-switch-app-ota-compress-lzma-shell-factory-data	tlsr9528a	FLASH	748560	748582	22	0.0
			RAM	70916	70932	16	0.0
	light-switch-app-ota-factory-data	tl3218x_retention	FLASH	725414	725436	22	0.0
			RAM	34608	34624	16	0.0
	lighting-app-ota-factory-data	tlsr9118bdk40d	FLASH	602692	602672	-20	-0.0
			RAM	108912	108928	16	0.0
	lighting-app-ota-rpc-factory-data-4mb	tlsr9518adk80d	FLASH	820896	820922	26	0.0
			RAM	92080	92096	16	0.0

jtrejoespinoza-grid · 2025-11-06T19:42:57Z

Some changes were made into run_python_test in the method monitor_app_restart_requests. The break from the while loop was removed because this only allowed one restart. Also the apps is stopped first to avoid por collisions in case the argument --secure-device-port is used to launch the app.

jtrejoespinoza-grid and others added 10 commits September 24, 2025 11:27

SU 2.5 Step 1 and 2

0cbf72c

Added basic logic for step 3

1e13b90

Added logic for step 4

97c59c2

Completed step 5 ( still need to check if we can confirm the download…

ec54e85

…ed image was deleted

Added step 5 , verify downloaded file check

8a571d0

Changes for SUBase

09c5210

Merge branch 'project-chip:master' into tc_softwareupdate2_5

ff0aca3

Incomming changes from su_base_class branch

d43bfca

Added line to show when the wait time of 3 minutes has completed.

45aef44

Updated wait times as the spec. Added secondary implementnation for e…

68ab5c1

…vent tracking as comments.

github-actions bot added the tests label Sep 29, 2025

jtrejoespinoza-grid added 3 commits September 29, 2025 14:56

Ruff and isort fix

ce5a054

Added better reading for step2: Added attribute wait for BasicInforma…

40bad1b

…tionCluster.Softwareversion to update it and verify it did not happend in less than the delaytime

isort check

6e457eb

jtrejoespinoza-grid added 8 commits October 8, 2025 16:38

Merge branch 'master' into tc_softwareupdate2_5

b403344

Merge branch 'master' into tc_softwareupdate2_5

4513ce2

Revert "Incomming changes from su_base_class branch"

13ded86

This reverts commit d43bfca.

base class changes

56823c7

Updates for 2.5

81e30af

Interval fix

19e4180

New updates for handling await time after apply or delayapplyupdate

c6e5dab

Fix invalid method for event handler

1d9ff88

jtrejoespinoza-grid added 4 commits October 17, 2025 10:09

Updated to user test arguments

438b4a7

Revert "base class changes"

de3fbe7

This reverts commit 56823c7.

Merge branch 'master' into tc_softwareupdate2_5

0ca5c31

Integrated su_base_class branch

e044f1c

Updated test to use test arguments

db81854

Remove read_from_logs. Verify with update state idle

f305ddd

jtrejoespinoza-grid marked this pull request as ready for review October 24, 2025 19:42

pullapprove bot added the review - pending label Oct 24, 2025

jtrejoespinoza-grid added 4 commits October 24, 2025 12:54

Merge branch 'master' into tc_softwareupdate2_5

9e3f36c

Revert "Integrated su_base_class branch"

0dc4b24

This reverts commit e044f1c.

Merge base class: Remove if needed

ab30ae1

ruff Changes

323f26d

Merge branch 'master' into tc_softwareupdate2_5

4525982

jtrejoespinoza-grid added 2 commits November 6, 2025 12:25

Minor changes for SU 2.5. Added restart and state value tracking.

4edda3f

Stop the app before start. Needed to avoid port collissions for apps …

9359df4

…launched with --secure-device-port. Removed break in monitor_app_requestor to allow multiple restarts

github-actions bot added the scripts label Nov 6, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Test Case Software Update 2.5 #41182

Test Case Software Update 2.5 #41182

jtrejoespinoza-grid commented Sep 29, 2025

Uh oh!

github-actions bot commented Oct 2, 2025

Uh oh!

github-actions bot commented Oct 11, 2025

Uh oh!

github-actions bot commented Oct 17, 2025

Uh oh!

github-actions bot commented Oct 24, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Nov 5, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Nov 6, 2025 •

edited

Loading

Uh oh!

jtrejoespinoza-grid commented Nov 6, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Test Case Software Update 2.5 #41182

Are you sure you want to change the base?

Test Case Software Update 2.5 #41182

Conversation

jtrejoespinoza-grid commented Sep 29, 2025

Summary

Related issues

Testing

Uh oh!

github-actions bot commented Oct 2, 2025

Uh oh!

github-actions bot commented Oct 11, 2025

Uh oh!

github-actions bot commented Oct 17, 2025

Uh oh!

github-actions bot commented Oct 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Nov 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Nov 6, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jtrejoespinoza-grid commented Nov 6, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

github-actions bot commented Oct 24, 2025 •

edited

Loading

github-actions bot commented Nov 5, 2025 •

edited

Loading

github-actions bot commented Nov 6, 2025 •

edited

Loading