test failed in CI: integration_tests::unauthorized::test_unauthorized #8612
Description
This test failed on a CI run on #8606:
https://github.com/oxidecomputer/omicron/pull/8421/checks?check_run_id=46066457312
Log showing the specific test failure:
Excerpt from the log showing the failure:
8185 2025-07-16T06:05:32.434Z FAIL [ 49.101s] omicron-nexus::test_all integration_tests::unauthorized::test_unauthorized
8186 2025-07-16T06:05:32.434Z stdout ───
8187 2025-07-16T06:05:32.436Z
8188 2025-07-16T06:05:32.436Z running 1 test
8189 2025-07-16T06:05:32.436Z sled b6d65341-167c-41df-9b5c-41cded99c229 successfully installed routes ResolvedVpcRouteSet { id: RouterId { vni: Vni(15386076), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }, version: None, routes: {} }
8190 2025-07-16T06:05:32.436Z sled b6d65341-167c-41df-9b5c-41cded99c229 successfully installed routes ResolvedVpcRouteSet { id: RouterId { vni: Vni(15386076), kind: System }, version: Some(RouterVersion { router_id: a5bdad7a-fdf6-4838-a9e4-a16d7eb29b30, version: 3 }), routes: {ResolvedVpcRoute { dest: V6(Ipv6Net { addr: fddb:4d11:aea9::, width: 64 }), target: VpcSubnet(V6(Ipv6Net { addr: fddb:4d11:aea9::, width: 64 })) }, ResolvedVpcRoute { dest: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), target: InternetGateway(Instance(735e2db1-7cdb-454f-9ded-bd6610c5ed90)) }, ResolvedVpcRoute { dest: V6(Ipv6Net { addr: ::, width: 0 }), target: InternetGateway(Instance(735e2db1-7cdb-454f-9ded-bd6610c5ed90)) }, ResolvedVpcRoute { dest: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), target: VpcSubnet(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }} }
8191 2025-07-16T06:05:32.436Z sled b6d65341-167c-41df-9b5c-41cded99c229 successfully installed routes ResolvedVpcRouteSet { id: RouterId { vni: Vni(15386076), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }, version: None, routes: {} }
8192 2025-07-16T06:05:32.438Z sled b6d65341-167c-41df-9b5c-41cded99c229 successfully installed routes ResolvedVpcRouteSet { id: RouterId { vni: Vni(15386076), kind: System }, version: Some(RouterVersion { router_id: a5bdad7a-fdf6-4838-a9e4-a16d7eb29b30, version: 4 }), routes: {ResolvedVpcRoute { dest: V6(Ipv6Net { addr: fddb:4d11:aea9::, width: 64 }), target: VpcSubnet(V6(Ipv6Net { addr: fddb:4d11:aea9::, width: 64 })) }, ResolvedVpcRoute { dest: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), target: InternetGateway(Instance(735e2db1-7cdb-454f-9ded-bd6610c5ed90)) }, ResolvedVpcRoute { dest: V6(Ipv6Net { addr: ::, width: 0 }), target: InternetGateway(Instance(735e2db1-7cdb-454f-9ded-bd6610c5ed90)) }, ResolvedVpcRoute { dest: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), target: VpcSubnet(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }} }
8193 2025-07-16T06:05:32.439Z sled b6d65341-167c-41df-9b5c-41cded99c229 successfully installed routes ResolvedVpcRouteSet { id: RouterId { vni: Vni(15386076), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }, version: None, routes: {} }
8194 2025-07-16T06:05:32.439Z
8195 2025-07-16T06:05:32.439Z SUMMARY OF REQUESTS MADE
8196 2025-07-16T06:05:32.439Z
8197 2025-07-16T06:05:32.439Z KEY, USING HEADER AND EXAMPLE ROW:
8198 2025-07-16T06:05:32.439Z
8199 2025-07-16T06:05:32.439Z +----------------------------> privileged GET (expects 200 or 500)
8200 2025-07-16T06:05:32.440Z | (digit = last digit of status code)
8201 2025-07-16T06:05:32.440Z |
8202 2025-07-16T06:05:32.444Z | +-> privileged GET (expects same as above)
8203 2025-07-16T06:05:32.444Z | | (digit = last digit of status code)
8204 2025-07-16T06:05:32.444Z | | ('-' => skipped (N/A))
8205 2025-07-16T06:05:32.444Z ^ ^
8206 2025-07-16T06:05:32.444Z HEADER: G GET PUT POST DEL TRCE G URL
8207 2025-07-16T06:05:32.445Z EXAMPLE: 0 3111 5555 3111 5555 5555 0 /organizations
8208 2025-07-16T06:05:32.445Z ROW ^^^^
8209 2025-07-16T06:05:32.445Z |||| TEST CASES FOR EACH HTTP METHOD:
8210 2025-07-16T06:05:32.445Z +|||----------------------< authenticated, unauthorized request
8211 2025-07-16T06:05:32.445Z +||----------------------< unauthenticated request
8212 2025-07-16T06:05:32.445Z +|----------------------< bad authentication: no such user
8213 2025-07-16T06:05:32.445Z +----------------------< bad authentication: invalid syntax
8214 2025-07-16T06:05:32.445Z
8215 2025-07-16T06:05:32.445Z \__/ \__/ \__/ \__/ \__/
8216 2025-07-16T06:05:32.445Z GET PUT etc. The test cases are repeated for each HTTP method.
8217 2025-07-16T06:05:32.445Z
8218 2025-07-16T06:05:32.445Z The number in each cell is the last digit of the 400-level response
8219 2025-07-16T06:05:32.445Z that was expected for this test case.
8220 2025-07-16T06:05:32.446Z
8221 2025-07-16T06:05:32.446Z In this case, an unauthenticated request to "GET /organizations" returned
8222 2025-07-16T06:05:32.446Z 401. All requests to "PUT /organizations" returned 405.
8223 2025-07-16T06:05:32.446Z
8224 2025-07-16T06:05:32.446Z G GET PUT POST DEL TRCE G URL
8225 2025-07-16T06:05:32.446Z 0 3111 3111 5555 5555 5555 0 /v1/system/policy
8226 2025-07-16T06:05:32.446Z 0 3111 5555 3111 5555 5555 0 /v1/system/ip-pools
8227 2025-07-16T06:05:32.451Z 0 -111 5555 5555 5555 5555 0 /v1/ip-pools
8228 2025-07-16T06:05:32.452Z 0 4111 4111 5555 4111 5555 0 /v1/system/ip-pools/default
8229 2025-07-16T06:05:32.452Z 0 -111 5555 5555 5555 5555 0 /v1/ip-pools/default?project=demo-project
8230 2025-07-16T06:05:32.452Z 0 4111 5555 4111 5555 5555 0 /v1/system/ip-pools/default/silos
8231 2025-07-16T06:05:32.452Z - 5555 4111 5555 4111 5555 - /v1/system/ip-pools/default/silos/demo-silo
8232 2025-07-16T06:05:32.452Z 0 4111 5555 5555 5555 5555 0 /v1/system/ip-pools/default/ranges
8233 2025-07-16T06:05:32.452Z - 5555 5555 4111 5555 5555 - /v1/system/ip-pools/default/ranges/add
8234 2025-07-16T06:05:32.452Z - 5555 5555 4111 5555 5555 - /v1/system/ip-pools/default/ranges/remove
8235 2025-07-16T06:05:32.453Z 0 4111 5555 5555 5555 5555 0 /v1/system/ip-pools/default/utilization
8236 2025-07-16T06:05:32.453Z 0 4111 5555 5555 5555 5555 0 /v1/system/ip-pools-service
8237 2025-07-16T06:05:32.453Z 0 4111 5555 5555 5555 5555 0 /v1/system/ip-pools-service/ranges
8238 2025-07-16T06:05:32.453Z - 5555 5555 4111 5555 5555 - /v1/system/ip-pools-service/ranges/add
8239 2025-07-16T06:05:32.453Z - 5555 5555 4111 5555 5555 - /v1/system/ip-pools-service/ranges/remove
8240 2025-07-16T06:05:32.453Z 0 3111 5555 3111 5555 5555 0 /v1/system/silos
8241 2025-07-16T06:05:32.453Z 0 4111 5555 5555 4111 5555 0 /v1/system/silos/demo-silo
8242 2025-07-16T06:05:32.453Z 0 4111 5555 5555 5555 5555 0 /v1/system/silos/demo-silo/ip-pools
8243 2025-07-16T06:05:32.453Z 0 4111 4111 5555 5555 5555 0 /v1/system/silos/demo-silo/policy
8244 2025-07-16T06:05:32.453Z 0 4111 4111 5555 5555 5555 0 /v1/system/silos/demo-silo/quotas
8245 2025-07-16T06:05:32.453Z 0 3111 5555 5555 5555 5555 0 /v1/system/silo-quotas
8246 2025-07-16T06:05:32.453Z 0 3111 5555 5555 5555 5555 0 /v1/system/utilization/silos
8247 2025-07-16T06:05:32.454Z 0 4111 5555 5555 5555 5555 0 /v1/system/utilization/silos/demo-silo
8248 2025-07-16T06:05:32.454Z 0 -111 5555 5555 5555 5555 0 /v1/utilization
8249 2025-07-16T06:05:32.454Z 0 -111 3111 5555 5555 5555 0 /v1/policy
8250 2025-07-16T06:05:32.454Z 0 -111 3111 5555 5555 5555 0 /v1/auth-settings
8251 2025-07-16T06:05:32.465Z 0 -111 5555 5555 5555 5555 0 /v1/users
8252 2025-07-16T06:05:32.465Z 0 -111 5555 5555 5555 5555 0 /v1/groups
8253 2025-07-16T06:05:32.465Z - -111 5555 5555 5555 5555 - /v1/groups/8d90b9a5-1cea-4a2b-9af4-71467dd33a04
8254 2025-07-16T06:05:32.465Z 0 -111 5555 5555 5555 5555 0 /v1/system/users?silo=default-silo
8255 2025-07-16T06:05:32.465Z - -555 5555 3111 5555 5555 - /v1/system/identity-providers/local/users?silo=default-silo
8256 2025-07-16T06:05:32.465Z 0 -111 5555 5555 55test integration_tests::unauthorized::test_unauthorized ... FAILED
8257 2025-07-16T06:05:32.465Z
8258 2025-07-16T06:05:32.466Z failures:
8259 2025-07-16T06:05:32.466Z
8260 2025-07-16T06:05:32.466Z failures:
8261 2025-07-16T06:05:32.466Z integration_tests::unauthorized::test_unauthorized
8262 2025-07-16T06:05:32.466Z
8263 2025-07-16T06:05:32.466Z test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 449 filtered out; finished in 49.01s
8264 2025-07-16T06:05:32.466Z
8265 2025-07-16T06:05:32.466Z stderr ───
8266 2025-07-16T06:05:32.466Z log file: /var/tmp/omicron_tmp/test_all-01daaf636e206a5a-test_unauthorized.226968.0.log
8267 2025-07-16T06:05:32.466Z note: configured to log to "/var/tmp/omicron_tmp/test_all-01daaf636e206a5a-test_unauthorized.226968.0.log"
8268 2025-07-16T06:05:32.466Z DB URL: postgresql://root@[::1]:44017/omicron?sslmode=disable
8269 2025-07-16T06:05:32.466Z DB address: [::1]:44017
8270 2025-07-16T06:05:32.466Z log file: /var/tmp/omicron_tmp/test_all-01daaf636e206a5a-test_unauthorized.226968.2.log
8271 2025-07-16T06:05:32.466Z note: configured to log to "/var/tmp/omicron_tmp/test_all-01daaf636e206a5a-test_unauthorized.226968.2.log"
8272 2025-07-16T06:05:32.466Z
8273 2025-07-16T06:05:32.466Z thread 'integration_tests::unauthorized::test_unauthorized' panicked at nexus/tests/integration_tests/unauthorized.rs:695:48:
8274 2025-07-16T06:05:32.467Z called `Result::unwrap()` on an `Err` value: Date header was too early